-- Logs begin at Thu 2022-08-11 15:36:37 UTC, end at Thu 2022-08-11 17:14:22 UTC. -- Aug 11 16:19:50.949491 dv-cinder-852208-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 16:19:50.959045 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 16:19:50 2022] *** Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: nodename: dv-cinder-852208-4-iscsi Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: machine: x86_64 Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: clock source: unix Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: pcre jit disabled Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: detected number of CPU cores: 4 Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: current working directory: / Aug 11 16:19:50.961047 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: detected binary path: /usr/bin/uwsgi-core Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: your processes number limit is 47680 Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: your memory page size is 4096 bytes Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: detected max file descriptor number: 2048 Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: lock engine: pthread robust mutexes Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: thunder lock: enabled Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 16:19:50.961828 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 16:19:51.000656 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: Python main interpreter initialized at 0x5563ac2ac9c0 Aug 11 16:19:51.000656 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: python threads support enabled Aug 11 16:19:51.000656 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: your server socket listen backlog is limited to 100 connections Aug 11 16:19:51.000656 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: your mercy for graceful operations on workers is 90 seconds Aug 11 16:19:51.001613 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 16:19:51.001821 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: *** Operational MODE: preforking *** Aug 11 16:19:51.002081 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: *** uWSGI is running in multiple interpreter mode *** Aug 11 16:19:51.002081 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: spawned uWSGI master process (pid: 105407) Aug 11 16:19:51.002270 dv-cinder-852208-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 16:19:51.008123 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: spawned uWSGI worker 1 (pid: 105408, cores: 1) Aug 11 16:19:51.008123 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: spawned uWSGI worker 2 (pid: 105409, cores: 1) Aug 11 16:19:51.008123 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 16:19:51.666995 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 16:19:51.675570 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 16:19:52.764033 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:19:52.764033 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: from cryptography.utils import int_from_bytes Aug 11 16:19:52.764647 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:19:52.764647 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: from cryptography.utils import int_from_bytes Aug 11 16:19:52.803742 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:19:52.803742 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Aug 11 16:19:52.804337 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:19:52.804337 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Aug 11 16:19:55.268571 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:19:55.269125 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:19:55.269342 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:19:55.269700 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:19:55.269961 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:19:55.270349 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.270676 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.271003 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.271324 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.271412 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:19:55.271758 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:19:55.271839 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.271952 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.272127 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:19:55.272300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.272483 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:19:55.272621 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.272742 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:19:55.272954 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273130 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273218 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273456 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273551 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273780 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.273882 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-4-iscsi {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274102 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274196 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274432 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274526 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274742 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.274847 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275059 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275154 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275455 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275688 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275775 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.275949 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.276036 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.276294 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.276523 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.276643 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-4-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.277708 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.277844 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.277953 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278049 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278146 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278244 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278326 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278406 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278486 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278582 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278672 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278753 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278838 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.278923 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279113 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279251 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279435 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279553 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279747 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.279835 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280194 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-4-iscsi {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280450 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280544 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280762 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.280859 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281070 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281156 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281387 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281469 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281696 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.281808 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.282019 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.282106 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.282404 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.282526 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.282758 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283025 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-4-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283231 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283352 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283567 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283654 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283895 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.283980 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.284244 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.284400 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.284571 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.284715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.284876 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285027 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285188 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285350 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285500 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285674 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285823 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.285984 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286137 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286328 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286444 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286737 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.286971 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287075 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287295 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287393 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287595 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287682 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287904 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.287990 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288187 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288273 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288446 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288553 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288768 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.288854 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289091 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289223 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289345 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289435 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289652 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289738 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.289972 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290058 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290280 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290447 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290588 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290673 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290837 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.290923 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291173 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291403 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291489 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291723 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.291819 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292030 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292136 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292364 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292449 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292670 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292755 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.292976 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293064 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293282 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293401 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293587 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293681 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293891 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.293976 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294195 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294282 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294511 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294605 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294825 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.294911 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295147 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295235 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295456 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295551 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295775 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.295861 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296087 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296264 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296427 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296528 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296732 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.296817 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297071 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297157 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297375 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297471 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297628 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.297725 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.298464 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.298661 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.298814 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299140 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299226 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299450 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299549 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299758 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.299857 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300064 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300184 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300393 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300494 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300702 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.300800 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301010 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301094 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301259 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301350 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301562 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301649 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301867 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.301953 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302186 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302271 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302490 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302575 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302793 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.302878 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303095 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303180 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303394 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303480 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303699 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.303792 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304004 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304090 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304336 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304428 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304724 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.304944 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305041 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305287 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305382 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305856 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.305940 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306157 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306252 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306476 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306562 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306783 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.306876 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307171 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307407 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307539 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307698 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307792 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.307999 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308120 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308333 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308420 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308640 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308726 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.308942 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309036 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309253 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309339 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309555 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309651 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309854 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.309938 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310160 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310246 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310462 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310556 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310765 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.310851 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311071 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311158 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311368 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311465 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311665 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311749 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.311978 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312061 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312309 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312406 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312612 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312706 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.312915 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.313020 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.313218 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.313305 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.314098 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.314323 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.314577 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.314667 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.314840 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.314976 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.315186 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.315272 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.315503 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.315600 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.315841 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.315946 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.316201 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.316303 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.316518 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.316603 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.316825 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.316912 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.317131 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.317218 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.317449 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:19:55.317544 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.317759 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.317846 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318090 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318179 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318387 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318560 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318707 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.318794 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319029 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319114 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319357 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319450 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319674 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.319762 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320260 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320578 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320665 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320890 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.320995 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321205 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321291 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321518 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321613 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321831 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.321918 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322141 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322225 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322459 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322552 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322790 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.322876 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323109 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323196 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323425 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323519 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323744 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.323831 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324055 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324155 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324395 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324490 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324709 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.324795 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325026 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325111 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325338 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325425 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325656 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325741 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.325980 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326067 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326296 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326390 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326615 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326701 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.326929 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327027 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327236 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327320 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327546 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327639 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327852 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.327949 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328227 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328316 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328549 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328635 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328863 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.328962 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.329443 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.329569 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.329877 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.329877 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330060 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330187 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330277 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330494 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330581 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330801 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.330899 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331108 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331203 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331421 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331507 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331725 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.331821 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332047 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332265 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332390 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332476 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332700 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.332802 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333009 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333094 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333323 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333421 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333632 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333747 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.333936 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334021 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334243 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334330 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334548 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334673 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334856 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.334941 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335162 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335259 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335465 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335550 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335793 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.335878 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336117 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336219 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336433 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336519 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336751 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.336836 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337057 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337148 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337364 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337449 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337674 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337760 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.337983 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338082 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338293 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338377 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338600 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338686 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.338908 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339003 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339231 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339316 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339536 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339621 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339843 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.339947 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340192 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340315 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340528 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340625 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340829 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.340929 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341148 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341236 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341460 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341554 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341771 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.341868 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342074 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342159 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342383 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342469 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342685 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342770 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.342991 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343077 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343298 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343384 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343611 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343695 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.343918 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344013 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344245 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344346 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344556 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344689 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.344893 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345198 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345323 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345518 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345606 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.345915 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346127 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346211 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346430 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346526 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346732 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.346817 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347036 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347121 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347347 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347442 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347653 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347746 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.347959 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348045 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348293 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348384 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348601 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348687 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.348907 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349005 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349231 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349319 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349542 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349629 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349847 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.349985 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350151 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350455 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350541 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350773 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.350867 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.351132 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.351217 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.351477 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.351767 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.351853 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352123 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352227 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352449 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352536 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352758 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.352858 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353075 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353161 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353382 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353467 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353691 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.353786 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354003 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354090 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354333 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354421 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354634 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354729 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.354945 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355033 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355263 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355357 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355598 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355700 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355885 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.355970 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356220 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356311 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356533 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356630 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356843 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.356930 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.357160 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.357247 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.357499 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.357725 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.357832 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358115 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358208 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358434 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358530 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358770 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.358868 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359066 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359158 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359372 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359466 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359682 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359769 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.359995 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.360156 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.360875 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361028 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361213 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361567 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361882 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.361979 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362207 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362295 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362522 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362609 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362836 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.362931 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363152 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363245 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363461 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363555 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363772 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.363867 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364080 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364214 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364422 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364510 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364736 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.364831 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365045 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365131 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365351 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365444 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365669 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365816 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.365980 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366077 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366287 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366374 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366589 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366675 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366894 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.366986 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367207 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367294 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367517 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367604 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367827 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.367919 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368160 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368264 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368471 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368558 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368772 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.368857 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369172 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369396 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369481 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369699 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.369784 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370002 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370101 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370313 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370409 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370635 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370722 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.370945 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371040 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371267 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371354 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371591 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371678 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.371899 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372067 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372324 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372558 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372644 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372868 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.372966 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373175 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373262 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373482 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373577 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373786 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.373874 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374093 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374178 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374407 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374499 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374720 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.374807 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375030 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375125 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375343 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375436 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375649 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.375735 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.376014 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.376731 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.376867 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.377153 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.377301 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.377460 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.377670 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.377764 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378001 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378101 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378322 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378631 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378718 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.378945 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379042 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379260 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379348 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379574 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379660 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379886 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.379974 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380227 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380365 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380545 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380631 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380858 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.380944 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381170 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381258 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381474 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381574 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381784 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.381871 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382090 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382187 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382398 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382651 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382736 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.382985 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383081 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383295 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383436 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383603 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383698 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.383915 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384011 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384244 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384343 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384553 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384647 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384859 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.384955 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385166 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385253 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385481 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385576 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385787 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.385873 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386092 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386187 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386395 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386480 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386702 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.386797 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387006 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387093 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387310 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387403 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387612 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387696 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.387914 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388000 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388240 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388345 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388550 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388660 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388852 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.388940 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389156 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389242 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389472 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389575 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389777 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.389864 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390088 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390174 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390392 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390496 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390713 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.390808 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391020 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391105 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391321 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391415 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391770 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.391864 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.392108 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.392424 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.392525 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.392740 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.392880 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393052 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393155 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393364 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393507 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393676 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393769 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.393980 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394067 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394291 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394386 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394596 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394691 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.394914 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395000 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395223 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395319 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395526 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395612 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395829 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.395915 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396159 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396283 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396469 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396581 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396771 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.396883 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397076 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397192 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397370 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397483 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397681 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397795 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.397986 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398074 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398284 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398369 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398606 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398751 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398886 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.398973 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399192 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399286 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399496 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399591 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399795 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.399887 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400116 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400205 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400428 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400569 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400729 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.400826 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401028 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401114 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401329 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401422 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401628 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401712 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.401933 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402018 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402233 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402327 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402536 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402622 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402839 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.402931 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403145 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403233 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403446 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403574 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403749 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.403837 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404049 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404148 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404391 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404476 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404691 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404787 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.404992 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405084 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405290 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405374 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405588 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405672 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405888 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.405973 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406195 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406279 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406509 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406602 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406814 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.406899 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.407117 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.407217 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.407557 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.407650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.407909 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408147 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408241 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408439 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408595 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408746 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.408905 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409057 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409223 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409362 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409543 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409666 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409855 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.409968 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410167 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410252 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410481 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410612 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410789 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.410883 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411104 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411197 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411415 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411509 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411727 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.411813 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412027 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412131 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412358 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412445 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412681 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412766 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.412994 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413080 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413306 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413402 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413620 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413704 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.413940 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414034 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414252 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414346 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414555 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414639 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414865 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.414962 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415171 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415257 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415486 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415572 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415794 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.415889 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416144 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416235 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416432 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416521 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416736 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.416836 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417063 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417149 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417372 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417457 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417679 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417782 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.417986 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418071 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418297 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418390 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418607 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418693 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418906 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.418990 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419214 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419521 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419608 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419825 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.419911 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420152 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420241 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420459 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420553 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420767 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.420868 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421068 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421153 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421374 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421499 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421683 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421811 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.421989 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.422123 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.422293 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.422429 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.422604 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.422741 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.423455 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.423759 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424005 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424092 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424431 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424527 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424747 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.424842 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425058 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425151 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425372 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425458 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425679 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425779 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.425990 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426075 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426296 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426388 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426659 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426745 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.426981 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427066 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427309 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427395 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427616 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427709 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.427919 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428003 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428252 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428338 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428571 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428658 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428884 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.428970 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.429189 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.429274 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.429605 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.429691 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.429918 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430004 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430228 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430323 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430539 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430626 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430842 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.430931 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431146 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431249 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431456 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431542 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431780 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.431873 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432084 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432208 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432411 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432499 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432716 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.432802 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433039 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433135 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433342 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433474 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433663 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.433749 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434016 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434101 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434335 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434428 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434646 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434792 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.434974 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435068 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435388 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435617 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435711 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.435944 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436029 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436304 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436393 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436633 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436721 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.436942 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437029 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437257 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437345 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437574 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437661 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437899 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.437991 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.438203 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.438289 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.439103 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.439201 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.439551 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.439649 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.439870 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440050 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440227 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440420 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440543 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440751 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.440896 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441072 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441161 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441401 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441486 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441755 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.441841 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442066 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442152 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442395 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442490 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442706 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.442792 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443033 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443126 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443341 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443436 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443652 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443746 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.443963 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.444059 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.444295 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.444395 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.444601 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.444687 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445173 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445264 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445476 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445570 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445779 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.445870 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446172 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446395 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446490 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446701 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.446793 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447006 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447094 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447334 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447422 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447639 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447725 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.447964 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448058 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448306 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448403 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448630 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448716 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.448949 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449033 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449251 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449336 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449572 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449658 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449878 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.449971 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450181 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450266 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450486 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450572 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450789 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.450886 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451098 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451204 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451400 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451487 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451710 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.451811 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452013 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452148 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452344 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452443 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452648 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452749 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.452973 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453061 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453279 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453367 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453602 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453749 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.453914 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.454001 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.454363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.454522 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.454685 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.454932 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455085 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455233 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455424 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455550 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455736 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.455861 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456071 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456238 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456478 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456571 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456787 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.456874 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457093 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457191 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457403 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457499 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457710 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.457796 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458031 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458141 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458336 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458431 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458652 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458737 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.458962 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459056 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459267 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459361 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459569 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459655 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459875 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.459962 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.460227 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.460330 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.460538 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.460751 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.460868 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461097 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461240 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461400 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461487 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461718 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.461807 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462036 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462136 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462352 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462439 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462667 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462753 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.462981 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463081 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463293 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463380 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463604 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463689 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.463915 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464050 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464251 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464351 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464569 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464655 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464887 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.464975 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.465221 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.465411 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.465540 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.465743 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.465838 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466058 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466145 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466372 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466458 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466684 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466801 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.466999 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467123 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467315 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467431 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467627 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467746 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.467939 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468061 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468276 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468401 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468587 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468713 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.468916 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.469024 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.469238 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.469334 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.469564 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.469664 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470012 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470107 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470351 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470584 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470671 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.470913 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471006 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471235 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471322 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471552 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.471910 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472002 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472251 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472360 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472564 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472658 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472879 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.472964 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.473192 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.473402 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.473510 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.473718 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.473825 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474056 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474142 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474382 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474477 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474707 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.474792 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475026 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475119 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475337 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475424 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475652 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475737 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.475957 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476050 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476291 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476378 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476607 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476695 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.476925 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477020 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477233 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477319 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477546 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477638 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477857 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.477942 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.478164 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.478370 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.478486 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.478684 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.478781 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479018 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479318 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479403 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479654 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479740 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.479974 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480061 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480319 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480405 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480646 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480733 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.480954 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481041 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481259 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481346 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481573 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481683 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481882 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.481975 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482183 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482268 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482497 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482595 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482803 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.482896 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483107 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483193 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483417 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483512 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483723 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.483810 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484034 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484282 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484372 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484632 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484727 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.484951 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.485037 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.485776 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.485881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.486096 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.486328 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.486414 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.486702 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.486786 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487017 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487105 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487417 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487640 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487725 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.487951 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488038 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488284 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488372 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488596 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488683 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488904 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.488989 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489208 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489292 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489515 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489608 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.489918 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490128 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490212 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490438 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490531 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490743 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.490830 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491068 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491153 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491370 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491463 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491679 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491773 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.491983 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492076 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492322 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492427 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492629 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492723 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.492936 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493022 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493242 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493339 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493548 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493634 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493861 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.493949 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.494166 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.494417 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.494515 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.494753 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.494841 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495062 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495157 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495366 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495453 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495676 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495762 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.495978 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496074 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496322 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496420 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496625 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496710 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.496947 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497033 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497262 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497348 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497577 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497662 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497885 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.497972 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498196 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498282 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498521 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498653 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498810 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.498896 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.499123 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.499209 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.499436 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.499668 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.499764 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500003 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500089 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500353 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500450 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500661 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.500746 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.501025 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.501134 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.501336 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502145 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502242 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502475 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502792 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.502879 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503108 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503202 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503425 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503510 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503738 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.503829 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504051 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504157 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504390 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504496 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504701 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.504788 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505012 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505100 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505326 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505420 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505727 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.505953 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506040 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506261 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506355 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506570 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506669 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506885 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.506972 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507199 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507286 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507516 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507616 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507836 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.507922 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508205 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508297 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508532 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508637 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508843 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.508929 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509158 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509243 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509468 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509561 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509778 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.509863 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510088 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510175 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510401 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510488 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.510801 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511033 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511120 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511337 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511422 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511644 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.511737 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512019 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512151 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512284 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512400 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512599 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512717 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.512907 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513038 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513214 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513361 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513526 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513673 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513833 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.513997 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514142 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514321 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514451 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514633 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514720 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.514957 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515051 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515270 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515364 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515599 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515695 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.515938 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516025 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516297 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516401 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516645 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516833 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.516951 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517264 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517350 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517578 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517664 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517885 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.517972 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518191 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518284 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518497 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518592 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518803 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.518890 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519129 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519213 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519440 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519536 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519755 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.519842 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520064 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520184 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520469 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520567 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520779 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.520866 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521172 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521397 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521493 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521704 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.521791 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522011 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522110 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522321 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522419 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522621 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522717 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.522926 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523013 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523232 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523319 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523544 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523629 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523849 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.523943 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524181 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524273 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524490 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524593 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524797 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.524884 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525104 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525191 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525420 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525505 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525748 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.525848 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526062 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526157 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526383 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526469 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526694 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.526788 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527005 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527091 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527314 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527399 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527640 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527819 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.527945 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528053 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528280 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528396 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528592 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528678 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528903 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.528989 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529223 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529317 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529533 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529619 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529843 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.529929 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530153 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530245 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530465 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530553 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530778 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.530864 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531105 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531189 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531418 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531505 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531725 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.531810 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.532053 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.532662 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.532938 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.533095 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.533447 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.533534 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.533804 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.533901 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534141 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534229 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534461 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534636 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534784 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.534886 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.535082 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.535169 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.535333 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:19:55.535419 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.535693 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.536006 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.536354 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.536672 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.536986 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.537307 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.537628 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.537963 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.538291 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.538605 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.538932 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.539260 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.539609 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.539924 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.540296 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.540630 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.540945 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.541258 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.541565 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:19:55.541812 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:19:55.691180 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Registered counter for database nova_api Aug 11 16:19:55.699487 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Registered counter for database nova_api Aug 11 16:19:55.711460 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.718033 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.719527 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.727451 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.774612 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.context [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8ad9f4c-7bec-4087-9085-6ed45237256a(cell1) {{(pid=105408) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 16:19:55.778467 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:19:55.778941 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:19:55.780535 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:19:55.781276 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:19:55.781742 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:19:55.784499 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.context [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8ad9f4c-7bec-4087-9085-6ed45237256a(cell1) {{(pid=105409) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 16:19:55.784636 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:19:55.786489 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Registered counter for database nova_cell0 Aug 11 16:19:55.788342 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:19:55.788824 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:19:55.790365 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:19:55.791102 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:19:55.791544 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:19:55.791922 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Registered counter for database nova_cell1 Aug 11 16:19:55.793561 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:19:55.795548 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Registered counter for database nova_cell0 Aug 11 16:19:55.800064 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.801906 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.802523 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Registered counter for database nova_cell1 Aug 11 16:19:55.807896 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.810086 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.810216 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.813383 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.816744 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.955363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Registered counter for database nova_cell0 Aug 11 16:19:55.961063 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.963525 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.967779 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:55.970667 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Registered counter for database nova_cell0 Aug 11 16:19:55.979749 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:19:55.984224 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:19:56.309211 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:19:56.310072 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:19:56.316624 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:19:56.317316 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:19:56.660195 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:19:56.662634 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:19:56.666056 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:19:56.668574 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:19:56.671387 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563ac2ac9c0 pid: 105409 (default app) Aug 11 16:19:56.673504 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:19:56.674103 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563ac2ac9c0 pid: 105408 (default app) Aug 11 16:19:56.674703 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-1572a550-4653-4b2b-b284-75dad0b89f39 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001783 Aug 11 16:19:56.675120 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Thu Aug 11 16:19:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:13.337459 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:13.338677 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Aug 11 16:21:13.339091 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:13.350455 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:13.351578 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:13.352697 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell1:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:13.353697 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:14.234423 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b10f0c5c-e6b6-4d0a-9491-50199e8a41bd admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:14.266806 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-b10f0c5c-e6b6-4d0a-9491-50199e8a41bd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921493 Aug 11 16:21:14.268234 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Aug 11 16:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:21:16.474136 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:16.475153 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-baae2c1f-952b-4ad9-8ad2-5052ef9b3c32 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 11 16:21:16.475545 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 2/4] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:16.936673 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-70e4e210-4bce-49ed-9f36-06d17845c84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:16.957443 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:16.957443 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: warnings.warn(msg) Aug 11 16:21:16.987883 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-70e4e210-4bce-49ed-9f36-06d17845c84d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505788 Aug 11 16:21:16.989170 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 3/5] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:21:17.213778 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-5b2c12dc-a7e4-442e-98b0-84680e2f63e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:17.218133 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:17.218133 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:21:17.221436 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:17.222282 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell0:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:17.223216 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell1:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:17.224056 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:17.285557 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-5b2c12dc-a7e4-442e-98b0-84680e2f63e6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288084 Aug 11 16:21:17.286151 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 3/6] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Aug 11 16:21:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:19.546510 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-70e4e210-4bce-49ed-9f36-06d17845c84d admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:19.547537 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-70e4e210-4bce-49ed-9f36-06d17845c84d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 11 16:21:19.547939 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 4/7] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:20.199282 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-f690ece4-aac1-4f45-97d3-a001142664af admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:20.247100 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:20.247100 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:21:20.267032 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-f690ece4-aac1-4f45-97d3-a001142664af admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712608 Aug 11 16:21:20.267777 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 4/8] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:21:20.280194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6490fa61-7e51-4fd0-bd7a-4cec4498770c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:20.283566 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:21:20.283566 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: warnings.warn(msg) Aug 11 16:21:20.322811 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-6490fa61-7e51-4fd0-bd7a-4cec4498770c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046831 Aug 11 16:21:20.332409 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 5/9] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Aug 11 16:21:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:21:22.562537 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-f690ece4-aac1-4f45-97d3-a001142664af admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:22.563558 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-f690ece4-aac1-4f45-97d3-a001142664af admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 11 16:21:22.563961 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:22.964322 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-90afef36-74b4-47d0-82dc-d38b248772dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "vcpus": 1, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:22.982626 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-90afef36-74b4-47d0-82dc-d38b248772dc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.412062 Aug 11 16:21:22.983179 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 6/11] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:21:22.995591 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-ee421da5-81cb-4044-9531-2159e16b5473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:23.020075 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-ee421da5-81cb-4044-9531-2159e16b5473 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028093 Aug 11 16:21:23.020696 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 6/12] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Aug 11 16:21:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:25.255428 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-90afef36-74b4-47d0-82dc-d38b248772dc admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:25.256478 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-90afef36-74b4-47d0-82dc-d38b248772dc admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 11 16:21:25.256875 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 7/13] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:25.701675 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-8c00e58a-67dd-4aaf-afde-f98271c85c58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:25.721058 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-8c00e58a-67dd-4aaf-afde-f98271c85c58 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458482 Aug 11 16:21:25.721591 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 7/14] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:25.733684 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-be2b6ed3-5a94-4feb-89b9-0c4d2f9a67ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:25.763993 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-be2b6ed3-5a94-4feb-89b9-0c4d2f9a67ff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033947 Aug 11 16:21:25.764873 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 8/15] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Aug 11 16:21:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:27.989648 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-8c00e58a-67dd-4aaf-afde-f98271c85c58 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:27.990659 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-8c00e58a-67dd-4aaf-afde-f98271c85c58 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 11 16:21:27.991088 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 8/16] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:28.438025 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:28.460024 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461984 Aug 11 16:21:28.460883 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 9/17] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:28.473963 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d8465c9b-b901-4cad-89cc-7028875bea82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:28.498164 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-d8465c9b-b901-4cad-89cc-7028875bea82 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028690 Aug 11 16:21:28.498976 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 9/18] 10.222.0.43 () {64 vars in 1336 bytes} [Thu Aug 11 16:21:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:30.901133 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:30.902308 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Aug 11 16:21:30.903030 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 10/19] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:31.308677 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-325e8630-eb1a-459f-874f-dbecdda7a814 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:31.334457 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-325e8630-eb1a-459f-874f-dbecdda7a814 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.424783 Aug 11 16:21:31.335000 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 10/20] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Aug 11 16:21:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:21:33.534036 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:33.535122 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5c97bf07-dd24-4c61-9da2-10e5e52231ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Aug 11 16:21:33.535524 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 11/21] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:33.978617 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-0f6fc681-f950-4bc3-a9d0-b25abb30d187 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1, "ram": 512}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:33.997915 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-0f6fc681-f950-4bc3-a9d0-b25abb30d187 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454696 Aug 11 16:21:33.998531 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 11/22] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:34.011076 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-21ab85cb-3158-47b2-be23-1e55d58643cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:34.038831 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-21ab85cb-3158-47b2-be23-1e55d58643cb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031232 Aug 11 16:21:34.039909 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 12/23] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Aug 11 16:21:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:36.232533 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-0f6fc681-f950-4bc3-a9d0-b25abb30d187 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:36.233561 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-0f6fc681-f950-4bc3-a9d0-b25abb30d187 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 11 16:21:36.233974 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:36.623915 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a4f5d7c5-7d40-4e6e-99b7-852412a2fc3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:36.643967 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-a4f5d7c5-7d40-4e6e-99b7-852412a2fc3f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.403393 Aug 11 16:21:36.644861 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 13/25] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:36.656754 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-5675b812-4704-45c4-ade6-4c6f9c98648b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:36.682311 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-5675b812-4704-45c4-ade6-4c6f9c98648b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029128 Aug 11 16:21:36.682944 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 13/26] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Aug 11 16:21:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:38.916310 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a4f5d7c5-7d40-4e6e-99b7-852412a2fc3f admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:38.917330 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-a4f5d7c5-7d40-4e6e-99b7-852412a2fc3f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 11 16:21:38.917744 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:39.343475 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-4b4cb558-68a3-489b-8a85-1741485f1803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "id": "3"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:39.364448 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-4b4cb558-68a3-489b-8a85-1741485f1803 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.440073 Aug 11 16:21:39.365763 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 14/28] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:39.380444 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-922b0513-3616-4886-89f9-ef67172e4ce6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:39.404387 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-922b0513-3616-4886-89f9-ef67172e4ce6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030063 Aug 11 16:21:39.404958 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 15/29] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Aug 11 16:21:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:21:41.654545 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-4b4cb558-68a3-489b-8a85-1741485f1803 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:41.655555 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-4b4cb558-68a3-489b-8a85-1741485f1803 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 11 16:21:41.660429 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 15/30] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:42.120183 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6f44da7c-40fd-4945-9e63-43de0bd00b6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:42.138899 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-6f44da7c-40fd-4945-9e63-43de0bd00b6b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476505 Aug 11 16:21:42.139580 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 16/31] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:42.151858 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-973966e2-1de5-4cdd-82e0-8ae2979ec44a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:42.179441 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-973966e2-1de5-4cdd-82e0-8ae2979ec44a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031318 Aug 11 16:21:42.180142 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 16/32] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Aug 11 16:21:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:21:44.427542 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6f44da7c-40fd-4945-9e63-43de0bd00b6b admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:21:44.429269 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-6f44da7c-40fd-4945-9e63-43de0bd00b6b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Aug 11 16:21:44.430248 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:21:44.871074 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:44.892028 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455450 Aug 11 16:21:44.901577 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 17/34] 10.222.0.43 () {64 vars in 1283 bytes} [Thu Aug 11 16:21:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:21:44.909130 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-aaddca9a-f5a8-469a-9b9f-bd4aa131f05b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:21:44.914150 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:21:44.939038 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-aaddca9a-f5a8-469a-9b9f-bd4aa131f05b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033791 Aug 11 16:21:44.940217 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 18/35] 10.222.0.43 () {64 vars in 1333 bytes} [Thu Aug 11 16:21:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:22:05.655345 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:05.656401 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 11 16:22:05.656803 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:06.044060 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-db62c13d-832d-46f4-9908-745266737234 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:06.063236 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-db62c13d-832d-46f4-9908-745266737234 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399698 Aug 11 16:22:06.063778 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Aug 11 16:22:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:22:07.138419 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:07.139441 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-642b84ea-120b-4153-9a6c-cb66a7cc8d00 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 11 16:22:07.139844 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:07.653925 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-db0f7454-c5a9-4a40-8629-dbabf7000aa3 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:07.659639 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-db0f7454-c5a9-4a40-8629-dbabf7000aa3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-db0f7454-c5a9-4a40-8629-dbabf7000aa3 admin admin] Request method failure captured: Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept: application/json Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Connection: keep-alive Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Content-Length: 0 Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Host: 10.222.0.43 Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABi9SyvQ8QssmmgkBy88s5DkQi06X_6OWg0lJm7EwtjR55cs57PLZzMdwhLZ6eVWxNDWQM291CRLWVkLBR1QaWZOoSC_IC_B0PWtCc70evVv7tiJ0jw7u24dfx5kqQPP8Q81OHE_lrKYzYP4DQaCcyyXWbKATn6ie9AOWzoo3Qw2TPRsLo Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Role: member,reader,admin Aug 11 16:22:07.662881 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Roles: member,reader,admin Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant: admin Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User: admin Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Name: admin Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: method: > Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: exception: Flavor 42 could not be found. Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: action_args: {'id': '42'} Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:07.664650 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:07.665715 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.667194 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-db0f7454-c5a9-4a40-8629-dbabf7000aa3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:07.668596 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-db0f7454-c5a9-4a40-8629-dbabf7000aa3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388149 Aug 11 16:22:07.668596 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Aug 11 16:22:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 16:22:07.673919 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d252b096-ee06-4b4b-b597-8ddcdbee10c7 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:07.678005 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:22:07.698006 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-d252b096-ee06-4b4b-b597-8ddcdbee10c7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027599 Aug 11 16:22:07.698625 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 20/40] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:22:07.708945 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-56b47acb-eec4-4607-a816-a99cbc26abc6 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:07.732745 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-56b47acb-eec4-4607-a816-a99cbc26abc6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027324 Aug 11 16:22:07.733304 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 21/41] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:22:07.742960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-3c3ed998-41d4-4439-9314-ecc16f67531b admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:07.749496 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-3c3ed998-41d4-4439-9314-ecc16f67531b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-3c3ed998-41d4-4439-9314-ecc16f67531b admin admin] Request method failure captured: Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept: application/json Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Connection: keep-alive Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Content-Length: 0 Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Host: 10.222.0.43 Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABi9SyvQ8QssmmgkBy88s5DkQi06X_6OWg0lJm7EwtjR55cs57PLZzMdwhLZ6eVWxNDWQM291CRLWVkLBR1QaWZOoSC_IC_B0PWtCc70evVv7tiJ0jw7u24dfx5kqQPP8Q81OHE_lrKYzYP4DQaCcyyXWbKATn6ie9AOWzoo3Qw2TPRsLo Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Role: member,reader,admin Aug 11 16:22:07.753639 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Roles: member,reader,admin Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant: admin Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User: admin Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Name: admin Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: method: > Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: exception: Flavor 42 could not be found. Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: action_args: {'id': '42'} Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:07.755238 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:07.756117 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:07.757397 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-3c3ed998-41d4-4439-9314-ecc16f67531b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:07.758634 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-3c3ed998-41d4-4439-9314-ecc16f67531b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015784 Aug 11 16:22:07.758634 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 21/42] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Aug 11 16:22:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 16:22:08.721425 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-56b47acb-eec4-4607-a816-a99cbc26abc6 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:08.722433 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-56b47acb-eec4-4607-a816-a99cbc26abc6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002371 Aug 11 16:22:08.722831 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 22/43] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:09.245348 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d5b07f27-abd5-4fa7-b20a-7dc1fb4ca8b4 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:09.250667 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-d5b07f27-abd5-4fa7-b20a-7dc1fb4ca8b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d5b07f27-abd5-4fa7-b20a-7dc1fb4ca8b4 admin admin] Request method failure captured: Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept: application/json Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Connection: keep-alive Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Content-Length: 0 Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Host: 10.222.0.43 Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABi9Sywexl8m18ccFNV7bjgy4gENK_aNkwIXQbejC8ePGi-CsTBu1J6UrKGZFdwtUKGoPA08laAFDIcWqoU1bhKK9aYD47lQ74ssLz9Y98SLn8rk-GHVe5zp0b9tZgYa6gtwwwb8RxsZFvEj5Lc5JyCzCb-9EWoV36WEWwGDcR8jOuA8wo Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Role: member,reader,admin Aug 11 16:22:09.252849 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Roles: member,reader,admin Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant: admin Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User: admin Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Name: admin Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: method: > Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: exception: Flavor 84 could not be found. Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: action_args: {'id': '84'} Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:09.254423 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:09.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.256562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d5b07f27-abd5-4fa7-b20a-7dc1fb4ca8b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:09.257835 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-d5b07f27-abd5-4fa7-b20a-7dc1fb4ca8b4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395577 Aug 11 16:22:09.257835 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Aug 11 16:22:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 16:22:09.263978 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-cee601fe-fa56-4b91-8e36-5acf7ee7e5ca admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:09.279442 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-cee601fe-fa56-4b91-8e36-5acf7ee7e5ca admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019070 Aug 11 16:22:09.279965 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:22:09.289365 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-79547b07-11de-45d0-8298-5459d99fef47 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:09.306485 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-79547b07-11de-45d0-8298-5459d99fef47 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020542 Aug 11 16:22:09.307007 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:22:09.316982 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ea7e6108-fcbd-45a9-9cce-175966d2d749 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:09.322338 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-ea7e6108-fcbd-45a9-9cce-175966d2d749 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ea7e6108-fcbd-45a9-9cce-175966d2d749 admin admin] Request method failure captured: Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept: application/json Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Connection: keep-alive Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Content-Length: 0 Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Host: 10.222.0.43 Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABi9Sywexl8m18ccFNV7bjgy4gENK_aNkwIXQbejC8ePGi-CsTBu1J6UrKGZFdwtUKGoPA08laAFDIcWqoU1bhKK9aYD47lQ74ssLz9Y98SLn8rk-GHVe5zp0b9tZgYa6gtwwwb8RxsZFvEj5Lc5JyCzCb-9EWoV36WEWwGDcR8jOuA8wo Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Role: member,reader,admin Aug 11 16:22:09.323823 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Roles: member,reader,admin Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant: admin Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User: admin Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Name: admin Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: method: > Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: exception: Flavor 84 could not be found. Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: action_args: {'id': '84'} Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:09.325640 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:09.326492 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:09.327551 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-ea7e6108-fcbd-45a9-9cce-175966d2d749 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:09.328788 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-ea7e6108-fcbd-45a9-9cce-175966d2d749 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012677 Aug 11 16:22:09.328788 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Aug 11 16:22:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 16:22:10.293502 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-79547b07-11de-45d0-8298-5459d99fef47 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:10.294533 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-79547b07-11de-45d0-8298-5459d99fef47 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 11 16:22:10.294920 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 24/48] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:10.814632 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3103fc99-050e-4832-bdd7-c5c3a3b730fe admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:10.820469 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-3103fc99-050e-4832-bdd7-c5c3a3b730fe admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3103fc99-050e-4832-bdd7-c5c3a3b730fe admin admin] Request method failure captured: Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept: application/json Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Connection: keep-alive Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Content-Length: 0 Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Host: 10.222.0.43 Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABi9SyysskkMRbKkIoC4x9mYM9UzzIYxSd2iHbaquKfAras67dATu5pQ-FfiMZOQEzlu2oLmnjFtEmiUHXEdXGjI-P5KnGeMsXlo2j0p7gVQad_b5tRFsGBU5zhr4uFX7VJQkmtUXd4FjltDB4Cn9inIGCjmNoNE9U3Mb2Wj9C3EO6TwLE Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Role: member,reader,admin Aug 11 16:22:10.821941 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Roles: member,reader,admin Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant: admin Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User: admin Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: X-User-Name: admin Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: method: > Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: exception: Flavor 451 could not be found. Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: action_args: {'id': '451'} Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:10.823641 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:10.824950 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.826271 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3103fc99-050e-4832-bdd7-c5c3a3b730fe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:10.827570 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-3103fc99-050e-4832-bdd7-c5c3a3b730fe admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388870 Aug 11 16:22:10.827570 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 25/49] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:22:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 11 16:22:10.833928 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-9efaeece-2400-41c2-9caf-a084d0c0e474 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:10.848562 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-9efaeece-2400-41c2-9caf-a084d0c0e474 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018217 Aug 11 16:22:10.849087 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 25/50] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:22:10.858302 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:10.873628 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018815 Aug 11 16:22:10.874158 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Aug 11 16:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:22:10.884064 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-24c83be0-02a5-4572-a9be-d37e03f1000f admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:10.889486 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-24c83be0-02a5-4572-a9be-d37e03f1000f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-24c83be0-02a5-4572-a9be-d37e03f1000f admin admin] Request method failure captured: Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept: application/json Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Connection: keep-alive Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Content-Length: 0 Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Host: 10.222.0.43 Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.90 Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABi9SyysskkMRbKkIoC4x9mYM9UzzIYxSd2iHbaquKfAras67dATu5pQ-FfiMZOQEzlu2oLmnjFtEmiUHXEdXGjI-P5KnGeMsXlo2j0p7gVQad_b5tRFsGBU5zhr4uFX7VJQkmtUXd4FjltDB4Cn9inIGCjmNoNE9U3Mb2Wj9C3EO6TwLE Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Role: member,reader,admin Aug 11 16:22:10.890960 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Roles: member,reader,admin Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_307850a266084dc1bb810ff53de8b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/307850a266084dc1bb810ff53de8b0aa"}]}] Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant: admin Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Id: 307850a266084dc1bb810ff53de8b0aa Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User: admin Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Id: ddf38f7f3d7248769f04c04a1b75ce6c Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: X-User-Name: admin Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: method: > Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: exception: Flavor 451 could not be found. Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: action_args: {'id': '451'} Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:22:10.892363 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:10.893332 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Aug 11 16:22:10.894711 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-24c83be0-02a5-4572-a9be-d37e03f1000f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:22:10.895946 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-24c83be0-02a5-4572-a9be-d37e03f1000f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012013 Aug 11 16:22:10.895946 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 26/52] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:22:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 16:22:11.856562 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:11.857564 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 11 16:22:11.857951 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:12.379756 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-1afe3e58-a314-41a9-872c-d988580ba61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:22:12.398335 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-1afe3e58-a314-41a9-872c-d988580ba61a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401466 Aug 11 16:22:12.398883 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 27/54] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Aug 11 16:22:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:22:13.374047 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:13.375060 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 11 16:22:13.375491 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:13.905523 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-4da4a1c8-3c4e-42d5-9c9b-134676db0fa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:22:13.925407 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-4da4a1c8-3c4e-42d5-9c9b-134676db0fa2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409006 Aug 11 16:22:13.925888 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 28/56] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Aug 11 16:22:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:22:14.892798 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:14.893811 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 11 16:22:14.894215 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:15.419069 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-3ae0a11a-6869-4857-8c39-ea08fb4a8248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:22:15.438271 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-3ae0a11a-6869-4857-8c39-ea08fb4a8248 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405209 Aug 11 16:22:15.438846 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 29/58] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Aug 11 16:22:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:22:16.514812 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:16.515946 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 11 16:22:16.516381 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 30/59] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:17.033890 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-6fc583b6-e5e9-4ef6-94ac-cedd08265b57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:22:17.053512 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-6fc583b6-e5e9-4ef6-94ac-cedd08265b57 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398071 Aug 11 16:22:17.054069 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 30/60] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Aug 11 16:22:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:22:18.023960 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:18.024993 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 11 16:22:18.025391 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 31/61] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:22:18.543582 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-39b296ce-9c04-451a-a907-05bc0c9a0c25 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:22:18.564120 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-39b296ce-9c04-451a-a907-05bc0c9a0c25 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400640 Aug 11 16:22:18.564667 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 31/62] 10.222.0.43 () {60 vars in 1202 bytes} [Thu Aug 11 16:22:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:23:09.786430 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:09.787434 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f4c25f8a-1463-43c2-bb6b-980bb024ca8e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 11 16:23:09.787835 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 931 bytes} [Thu Aug 11 16:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:23:09.798325 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:10.178897 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a327ca4f-de1b-41d2-9658-bc4b56095241 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:10.200821 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a327ca4f-de1b-41d2-9658-bc4b56095241 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406849 Aug 11 16:23:10.201299 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 32/64] 10.222.0.43 () {60 vars in 1292 bytes} [Thu Aug 11 16:23:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:23:10.224174 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-31d65a6a-247a-40c1-9169-8eeeeeb130bc admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:10.228418 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:23:10.233734 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-31d65a6a-247a-40c1-9169-8eeeeeb130bc admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013197 Aug 11 16:23:10.234266 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 33/65] 10.222.0.43 () {60 vars in 1283 bytes} [Thu Aug 11 16:23:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:23:10.246686 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-15923a27-2156-4cb2-b1e5-cdf70ab9a787 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:10.254300 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-15923a27-2156-4cb2-b1e5-cdf70ab9a787 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012196 Aug 11 16:23:10.254810 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 33/66] 10.222.0.43 () {60 vars in 1286 bytes} [Thu Aug 11 16:23:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:23:10.267347 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:10.275696 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012089 Aug 11 16:23:10.276238 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 34/67] 10.222.0.43 () {60 vars in 1286 bytes} [Thu Aug 11 16:23:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:23:10.287284 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-978875a9-b00c-47e2-8fd8-7d10d2e8e065 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:23:10.295816 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-978875a9-b00c-47e2-8fd8-7d10d2e8e065 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011985 Aug 11 16:23:10.296377 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 34/68] 10.222.0.43 () {60 vars in 1283 bytes} [Thu Aug 11 16:23:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:26:02.372481 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:02.373548 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 11 16:26:02.373960 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:26:02.530341 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=6 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:02.692347 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:02.694680 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:26:02.694680 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:26:02.695791 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:02.696290 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:02.696775 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:02.697457 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:02.697894 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:02.698307 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:02.732512 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-59d6dbf7-2da7-4750-aeb3-289dd9bb5c3d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203628 Aug 11 16:26:02.733067 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 35/70] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:26:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:26:03.579960 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:03.581000 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 11 16:26:03.581398 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:26:03.795218 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:03.797622 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:26:03.797622 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:26:03.798760 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:03.799239 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:03.799664 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:03.800396 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:03.800862 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:03.801337 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:03.822122 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-6b6cfed3-f6d5-45de-8b8d-592add633b98 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081545 Aug 11 16:26:03.822695 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 36/72] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:26:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:26:15.105173 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:15.106345 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Aug 11 16:26:15.106771 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:26:15.252463 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell0:SELECT=4 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.253193 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell1:SELECT=4 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.254093 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=8 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:26:15.302719 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:15.305179 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:26:15.305179 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:26:15.306325 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:15.306741 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:15.307213 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:15.308805 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:15.309221 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:15.309630 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:15.334494 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-87b4a40c-c942-48d3-9909-a8b9c7d6bc73 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087750 Aug 11 16:26:15.335051 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 37/74] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:26:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:26:16.164891 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:16.165937 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-328a7c32-d18d-4521-8abd-ec3766ad418a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 11 16:26:16.166340 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Aug 11 16:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:26:16.364899 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:26:16.367294 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 16:26:16.367294 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: warnings.warn(msg) Aug 11 16:26:16.368429 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:16.368901 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:16.369326 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:16.370031 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:26:16.371225 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:26:16.371822 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:26:16.393520 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-f111c5ee-0e35-48c8-9bd8-17b7eea56a4d admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083596 Aug 11 16:26:16.394071 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 38/76] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Aug 11 16:26:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:27:12.315519 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: Thu Aug 11 16:27:12 2022 - graceful shutdown triggered... Aug 11 16:27:12.316025 dv-cinder-852208-4-iscsi devstack@n-api.service[105408]: Gracefully killing worker 1 (pid: 105408)... Aug 11 16:27:12.317264 dv-cinder-852208-4-iscsi devstack@n-api.service[105409]: Gracefully killing worker 2 (pid: 105409)... Aug 11 16:27:12.319372 dv-cinder-852208-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 11 16:27:13.316288 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: worker 1 buried after 1 seconds Aug 11 16:27:13.316288 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: worker 2 buried after 1 seconds Aug 11 16:27:13.316288 dv-cinder-852208-4-iscsi devstack@n-api.service[105407]: goodbye to uWSGI. Aug 11 16:27:13.317862 dv-cinder-852208-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 11 16:27:13.318405 dv-cinder-852208-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 11 16:27:13.321274 dv-cinder-852208-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 16:27:13.331059 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 16:27:13.333068 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 16:27:13 2022] *** Aug 11 16:27:13.334899 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 16:27:13.335065 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 16:27:13.335184 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: nodename: dv-cinder-852208-4-iscsi Aug 11 16:27:13.335299 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: machine: x86_64 Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: clock source: unix Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: pcre jit disabled Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: detected number of CPU cores: 4 Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: current working directory: / Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: detected binary path: /usr/bin/uwsgi-core Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: your processes number limit is 47680 Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: your memory page size is 4096 bytes Aug 11 16:27:13.335423 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: detected max file descriptor number: 2048 Aug 11 16:27:13.335968 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: lock engine: pthread robust mutexes Aug 11 16:27:13.335968 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: thunder lock: enabled Aug 11 16:27:13.335968 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 16:27:13.335968 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 16:27:13.378174 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: Python main interpreter initialized at 0x55ba66f7b9c0 Aug 11 16:27:13.378174 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: python threads support enabled Aug 11 16:27:13.378174 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: your server socket listen backlog is limited to 100 connections Aug 11 16:27:13.378174 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: your mercy for graceful operations on workers is 90 seconds Aug 11 16:27:13.378587 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 16:27:13.378587 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: *** Operational MODE: preforking *** Aug 11 16:27:13.378894 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: *** uWSGI is running in multiple interpreter mode *** Aug 11 16:27:13.379059 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: spawned uWSGI master process (pid: 120710) Aug 11 16:27:13.379397 dv-cinder-852208-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 16:27:13.380133 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: spawned uWSGI worker 1 (pid: 120730, cores: 1) Aug 11 16:27:13.382147 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: spawned uWSGI worker 2 (pid: 120731, cores: 1) Aug 11 16:27:13.382147 dv-cinder-852208-4-iscsi devstack@n-api.service[120710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 16:27:14.048238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 16:27:14.067173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 16:27:15.215204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:27:15.215204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: from cryptography.utils import int_from_bytes Aug 11 16:27:15.215828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:27:15.215828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: from cryptography.utils import int_from_bytes Aug 11 16:27:15.271688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:27:15.271688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: from cryptography.utils import int_from_bytes Aug 11 16:27:15.272401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 16:27:15.272401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: from cryptography.utils import int_from_bytes Aug 11 16:27:17.566602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:27:17.567193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:27:17.567389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:27:17.567750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:27:17.568009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:27:17.568426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.568755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.569078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.569397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.569731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.570043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.570366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.570686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.571024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.571322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.571635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.571934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-4-iscsi {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.572327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.572601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.573055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.573387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.573693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.574021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.574343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.574843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.576224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.576224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.576452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.577065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.577065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.577389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.577724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.578037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.578351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.578665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.579240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-4-iscsi {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.579374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.579688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.580091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.580449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.580759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.581065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.581391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.581820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.582085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.582337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.582749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.583017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.583556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.583779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.584104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.584469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.584795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.585058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.585375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.585626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.585934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.586257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.586580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.586905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.587160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.587455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.587817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.588056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.588426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.588791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.589054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.589347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.589644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.589945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.590249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.590623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.590872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.591189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.591532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.591822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.592168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.592572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.592829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.593138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.593479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.593798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.594109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.594426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.594749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.595056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.595369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.595678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.595998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.596356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.596662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.596916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.597217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.597521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.597841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.598149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.598482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.598763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.599064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.599371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.599679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.599986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.600317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.600624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.600930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.601240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.601548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.601854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.602175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.602495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.602803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.603120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.603415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.603722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.604713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.605041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.605358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.605687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.605999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.606311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.606634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.606946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.607256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.607580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.607884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.608218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.608543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.608861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.609165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.609472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.609780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.610086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.610393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.610699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.611013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.611315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.611642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.611965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.612301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.612614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.612922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.613243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.613586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.613923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.614267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.614586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.614928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.615261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.615584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.615903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.616244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.616577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.616893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.617209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.617522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.617842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.618164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.618499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.618814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.619138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.619671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.620494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.620812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.621171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.621465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.621780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.622128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.622473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.622808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.623117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.623443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.623759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.624073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.624411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.624738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.625077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.625393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.625716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.626031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.626346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.626658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.626971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.627286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.627626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.627944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.628289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.628610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.628929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.629248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.629566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.629879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.630187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.630496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.630804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.631120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.631428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.631756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.632127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.632429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.632769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.633079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.633393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.633711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.634036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.634337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.634655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.634970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.635361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.635692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.636010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.636346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.636675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.636986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.637297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.637615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.637929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.638243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.638560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.638880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.639212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.639527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.639846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.640205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.640540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.640849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.641186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.641502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.641821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.642128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.642441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.642747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.643055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.643361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.643695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.643991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.644324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.644822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.645008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.648528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.649895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.650203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.650517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.650866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.651184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.651507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.651819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.652371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.652494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.652792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.653098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.653415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.653755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.654091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.654410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.654740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.655155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.655371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.655682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.655994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.656329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.656642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.656962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.657273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.657591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.657903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.658228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.658541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.658863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.659169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.659485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.659901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.660169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.660467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.660781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.661103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.661452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.661825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.662029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.662336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.662643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.662952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.663257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.663568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.663878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.664207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.664528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.664841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.665151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.665457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.665769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.666094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.667006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.667281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.667608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.667916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.668246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.668574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.668886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.669192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.669500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.669808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.670199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.670464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.670773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.671093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.671418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.671731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.672052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.672390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.672705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.673035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.673350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.673664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.673979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.674293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.674606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.674920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.675252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.675568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.675880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.676217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.676612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.677025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.677528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.677751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.678163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.678525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.679194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.679194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.679591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.680010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.680010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.680660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.680957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.683647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.683647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.683647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.683647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.683647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.684615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.684615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.684893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.685048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.685325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.685932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.686123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.686447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.686678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.686896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.687329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.687665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.688002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.688355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.688714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.689113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.689457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.689788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 16:27:17.690717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.690889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 16:27:17.691060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.691060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.691419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 16:27:17.691619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.691861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 16:27:17.692149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.692312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 16:27:17.692459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.692632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.692783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.692933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.693075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.693413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.693565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.693708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.693857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.694007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.694156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.694340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.694499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.694642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.694802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.694945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.695095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.695238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.695417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.695566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.695970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.696155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.696329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.696516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-4-iscsi {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.696672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.696816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.696958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.697114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.697266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.697408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.697568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.697820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.697971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.698123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.698281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.698515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.698784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.699117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.699397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.699397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.699712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.699885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.699885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.700264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.700408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.700818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.700973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.701124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.701267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.701417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.701570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.701771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.701916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.702058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.702296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.702444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.702595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.702746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.702889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.703030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.703178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.703320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.703621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.703621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.703909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-4-iscsi {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.704053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.704262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.704425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.704576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.704718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.704859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.705002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.705152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.705304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.705447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.705596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.705756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.705905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.706159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.706312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.706454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.706608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.706750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.706892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.707048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.707199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.707349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.707492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.707649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.707828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.708092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.708259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.708403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.708556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.708754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.708921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.709065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.709218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.709361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.709510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.709653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.709814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.709958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.710119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.710584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.710954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.711116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.711269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.711420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.711562 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.711755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.711903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.712046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.712267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.712498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.712498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.712777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.712919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.713076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.713227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.713391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.713713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.713885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.714046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.714280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.714426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.714579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.714728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.714878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.715030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.715180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.715322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.715472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.715615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.715764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.715920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.716070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.716333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.716490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.716645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.716787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.716787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.717066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.717215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.717215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.717493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.717636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.717786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.717928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.717928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.718294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.718294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.718591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.718735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.718877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.719018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.719168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.719501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.719668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.719820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.719963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.720135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.720284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.720426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.720612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.720835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.721180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.721345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.721489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.721632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.721829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.721976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.722118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.722118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.722388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.722627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.722785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.722785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.723071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.723213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.723362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.723513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.723673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.723891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.724038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.724215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.724367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.724519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.724661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.725423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.725580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.725741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.725884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.726048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.726206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.726373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.726610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.726767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.726923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.727093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.727243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.727401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.727563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.727713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.727871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.728021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.728399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.728562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.728720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.728869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.729541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.729699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.729849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.730179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.730179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.730496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.730660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.730830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.731313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.731486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.731653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.731812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.732020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.732193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.732347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.732514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.732754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.732910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.733072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.733229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.733395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.733545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.733773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.734017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.734182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.734333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.734493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.734651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.734808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.734965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.735121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.735282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.735446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.735596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.735596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.735880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.736029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.736224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.736393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.736546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.736811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.736967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.737125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.737296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.737447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.737608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.737758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.737907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.738064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.738228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.738388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.738644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.738798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.738947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.739111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.739280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.739441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.739591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.739748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.739898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.740147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.740318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.740468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.740619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.740768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.740917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.741105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.741593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 16:27:17.741753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.741957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.742969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.743931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.744209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.744376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.744597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.745270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.745606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.745804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.746970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.747916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.748969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.749919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.750944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.751109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.751272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.751709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.751865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.752708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.753881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.754942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.755940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.756927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.757956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.758203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.758203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.758510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.758661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.758827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.759991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.760272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.760272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.760587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.760835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.760992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.761152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.761303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.761469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.761933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.762939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.763960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.764154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.764322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.764580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.764745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.764904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.765983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.766905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.767984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.768169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.768354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.769760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.770990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.771148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.771306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.771465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.771628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.772956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.773973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.774144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.774297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.774447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.774680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.774849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.775989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.776868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.777938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.778811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.779989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.780194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.780366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.780531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.780689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.780847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.781786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.782199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.782407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.782407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.782729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.782881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.783917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.784976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.785891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.786979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.787274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.787432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.787597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.787760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.787921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.788946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.789930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.790973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.791098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.791211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.791321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.791957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.791957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.792547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.792786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.792901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.793942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.794987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.795928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.796987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797107 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.797905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.798554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.798786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.798922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.799952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.800905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.801970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.802529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.802675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.802805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.802934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.803859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.804954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.805964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.806913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.807337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.807980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.808278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.808403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.808403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.808403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.808879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.809785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.810997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.811133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.811270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.811270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.811549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.812262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.812728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.812864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.812864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.813926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.814907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.815905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.816927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.817876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.818890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.819932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.820971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.821867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.822111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.822240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.822240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.822828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.822972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.823895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.824842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.825951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.826992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.827898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.828656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.829876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.830965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.831236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.831367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.831568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.831716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.831887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.832172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.832323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.832526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.832947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.833091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:27:17.833232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.833439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.833818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.834198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.834578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.834966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.835349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.835730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.836268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.836549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.836929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.837309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.837695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.838071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.838971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.839992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.840433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.843901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.846252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.847422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.847422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.847422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.847927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.848333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.848727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.849126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.849515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.849903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.850292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.850672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.851061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.851472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.851860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.852268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.852653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.853058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.853634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.853808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.854892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.855871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.856306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.856860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.857062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.857450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.857852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.858380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.858615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.859007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.859404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.859789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.860206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.860529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.860845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.861205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.861527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.861841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.862181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.862500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.862813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.863126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.863439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.863752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.864078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.864551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.864862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.865176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.865486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.865802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.866115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.866437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.866760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.867070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.867498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.867816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.868158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.868469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.868777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.869084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.869398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.869773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.870733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.871054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.871372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.871709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.872027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.872385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.872829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.873156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.873470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.873896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.874215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.874531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.874859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.875188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.875517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.875827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.876253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.876486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.876815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.877144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.877462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.877783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.878092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.878418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.878743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.879061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.879387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.879821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.880189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.880509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.880840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.881182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.881469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.882357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.882357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.882357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.882812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.882988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.883300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.883618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.884203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.884385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.884594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.884870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.885333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.886392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.886769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.887047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.887386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.887702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.888013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.888368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.888684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.888993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.889308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.889738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.889959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.890269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.890602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.890937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.891269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.891585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.891920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.892276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.892602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.892927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.893257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.893565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.893872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.894190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.894500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.894809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.895117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.895428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.895733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.896047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.896383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.896716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.897025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.897351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.897853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.897975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.898261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.898597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.898912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.899220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.899555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.899867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.900230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.900576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.901442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.902491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.902819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.903144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.903467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.903787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.904241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.904517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.904757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.905079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.905672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.906013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.906336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.906656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.906975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.907295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.907610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.907943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.908277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.908595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.908911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.909252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.909578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.909911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.910255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.910580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.910897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.911215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.911538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.911900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.912241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.912556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.912876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.913193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.913510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.913824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.914136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.914451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.914769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.915082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.915394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.915710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.916025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.916401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.917989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.918324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.918650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.918974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.919296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.919884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.920234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.920580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.920914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.921247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.921576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.921900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.922236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.922548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.922857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.923173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.923489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.923796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.924142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.924461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.924769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.925092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.925404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.925942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.926295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.926614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.926942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.927272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.927592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.927900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.928257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.928574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.928871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.929191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.929506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.929814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.930122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.930435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.930748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.931057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.931375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.931680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.932306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.933166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.933479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.933791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.934110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.934420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.934732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.935042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.935350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.935736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.935974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.936314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.936624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.936939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.937247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.937560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.937866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.938194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.938504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.938865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.939185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.939500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.939827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.940159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.940477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.940829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.941149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.941705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.942042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.942365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.942701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.943035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.943345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.943654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.943961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.944313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.944627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.944941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.945253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.945563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.945874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.946186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.946499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.946808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.947119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.947429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.948357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.948690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.949008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.949323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.949642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.949990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.950315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.950636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.950958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.951275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.951593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.951903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.952239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.952553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.952870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.953202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.953516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.953824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.954250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.954570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.954891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.955213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.955529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.955851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.956197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.956514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.956839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.957151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.957481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.957823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.958154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.958480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.958838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.959097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.959404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.959714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.960034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.960370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.960676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.960979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.961296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.961599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.961904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.962207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.962511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.962820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.963122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.964414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.964738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.965050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.965359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.965668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.965980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.966288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.966594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.966898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.967202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.967505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.967838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.968201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.968524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.968848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.969162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.969487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.969799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.970122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.970445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.970761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.971073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.971413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.971728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.972042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.972379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.972693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.973005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.973317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.973645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.973974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.974282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.974609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.974931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.975256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.975574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.975886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.976245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.976560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.976871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.977186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.977498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.977809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.978125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.978435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.978744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.980131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.980473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.980818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.981157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.981486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.981824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.982164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.982518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.982840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.983192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.983526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.983849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.984195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.984504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO dbcounter [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Registered counter for database nova_api Aug 11 16:27:17.984613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 16:27:17.984752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 16:27:18.005336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.012520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writer thread running {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.072602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.context [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8ad9f4c-7bec-4087-9085-6ed45237256a(cell1) {{(pid=120730) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 16:27:18.077081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:27:18.077565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:27:18.079170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:27:18.079949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:27:18.080426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:27:18.082430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:27:18.084459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO dbcounter [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Registered counter for database nova_cell0 Aug 11 16:27:18.089363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO dbcounter [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Registered counter for database nova_cell1 Aug 11 16:27:18.096908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.100988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.102508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writer thread running {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.140306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Registered counter for database nova_api Aug 11 16:27:18.161075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.168801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.226970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.context [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8ad9f4c-7bec-4087-9085-6ed45237256a(cell1) {{(pid=120731) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 16:27:18.231539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:27:18.232013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:27:18.233612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:27:18.234368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:27:18.234815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:27:18.236823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:27:18.238785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Registered counter for database nova_cell0 Aug 11 16:27:18.242959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Registered counter for database nova_cell1 Aug 11 16:27:18.246470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writer thread running {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.250931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.252621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.255584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO dbcounter [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Registered counter for database nova_cell0 Aug 11 16:27:18.258957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.261133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.267219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.271711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writer thread running {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.414488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO dbcounter [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Registered counter for database nova_cell0 Aug 11 16:27:18.421743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_db.sqlalchemy.engines [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 16:27:18.426492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writer thread running {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 16:27:18.595563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: WARNING keystonemiddleware.auth_token [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:27:18.602858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: WARNING keystonemiddleware.auth_token [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:27:18.758418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:27:18.768127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:27:18.950645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: WARNING keystonemiddleware.auth_token [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:27:18.957006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: WARNING keystonemiddleware.auth_token [None req-2f8a5f44-7f5b-4980-bacf-1756d571fca6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:27:18.964316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba66f7b9c0 pid: 120730 (default app) Aug 11 16:27:19.123493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 16:27:19.129638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: WARNING keystonemiddleware.auth_token [None req-73f8db87-d351-4bf3-8042-1e6246896a3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 16:27:19.137178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba66f7b9c0 pid: 120731 (default app) Aug 11 16:27:53.423214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:53.424776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:53.426700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:53.427708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:54.646319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-308695e0-967e-41c6-a791-0056e24ad64c tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Action: 'create', calling method: .version_select at 0x7f6149534e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1572291941"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:27:54.708935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:54.711050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:54.713942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:54.717208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:27:56.192939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b389ceb1-6a43-49e4-9283-9555a9a30d3e tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Action: 'create', calling method: .version_select at 0x7f6149540dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-907528633", "metadata": {"Type": "work"}}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b389ceb1-6a43-49e4-9283-9555a9a30d3e tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 121 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:27:56.201933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-907528633", "metadata": {"Type": "work"}}} Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: Aug 11 16:27:56.203357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-907528633', 'metadata': {'Type': 'work'}}}} Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise error Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi '#$%' Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:56.204385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 16:27:56.206054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 16:27:56.207534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 16:27:56.207534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.209071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b389ceb1-6a43-49e4-9283-9555a9a30d3e tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:56.210311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b389ceb1-6a43-49e4-9283-9555a9a30d3e tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.510858 Aug 11 16:27:56.211819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Aug 11 16:27:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:27:56.242302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a0d59c3-6898-484d-a403-17e9ba5943a4 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Action: 'create', calling method: .version_select at 0x7f614944c8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1548522411", "metadata": {"Type": "work"}}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a0d59c3-6898-484d-a403-17e9ba5943a4 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 120 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:27:56.246788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1548522411", "metadata": {"Type": "work"}}} Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: Aug 11 16:27:56.248374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1548522411', 'metadata': {'Type': 'work'}}}} Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise error Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi '0' Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:56.249312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 16:27:56.250926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 16:27:56.252353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 16:27:56.252353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.252353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a0d59c3-6898-484d-a403-17e9ba5943a4 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:56.263764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a0d59c3-6898-484d-a403-17e9ba5943a4 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021431 Aug 11 16:27:56.268752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Aug 11 16:27:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:27:56.278017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5194d826-a806-419b-a8fc-d8aed867a354 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Action: 'create', calling method: .version_select at 0x7f61494069d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-51962693", "metadata": {"Type": "work"}}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5194d826-a806-419b-a8fc-d8aed867a354 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 117 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:27:56.281755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-51962693", "metadata": {"Type": "work"}}} Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: Aug 11 16:27:56.283320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-51962693', 'metadata': {'Type': 'work'}}}} Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise error Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi '' Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:56.284274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 16:27:56.285951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 16:27:56.287267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 16:27:56.287267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.287267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5194d826-a806-419b-a8fc-d8aed867a354 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:56.287267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5194d826-a806-419b-a8fc-d8aed867a354 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013478 Aug 11 16:27:56.291612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Aug 11 16:27:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:27:56.297090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72ba4d7a-b97e-4c95-8ee1-832d8b2d3ff3 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Calling method '.version_select at 0x7f6149406670>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:56.548214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-308695e0-967e-41c6-a791-0056e24ad64c tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.143394 Aug 11 16:27:56.548840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1/4] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Aug 11 16:27:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3147 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 11 16:27:56.564955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-20f8bf48-9b4b-47c9-b2c0-4dfdcf682b87 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61493b7ca0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:56.655991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-20f8bf48-9b4b-47c9-b2c0-4dfdcf682b87 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 200 len: 345 microversion: 2.1 time: 0.096168 Aug 11 16:27:56.656776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 2/5] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:27:56 2022] GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:27:56.851128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-72ba4d7a-b97e-4c95-8ee1-832d8b2d3ff3 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] HTTP exception thrown: Volume tempest-invalid-38602208 could not be found. Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72ba4d7a-b97e-4c95-8ee1-832d8b2d3ff3 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-38602208 HTTP/1.1 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:27:56.855867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Volume tempest-invalid-38602208 could not be found. Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'tempest-invalid-38602208'} Aug 11 16:27:56.857644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-38602208 could not be found. (HTTP 404) (Request-ID: req-76aeb73f-88f9-402f-bc03-4e90df4ffe8a) Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.858663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:27:56.860222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-38602208 could not be found. Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:27:56.861619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-38602208 could not be found. Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-38602208 could not be found. Aug 11 16:27:56.863239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.866504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72ba4d7a-b97e-4c95-8ee1-832d8b2d3ff3 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 404 to user: Volume tempest-invalid-38602208 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:56.868336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72ba4d7a-b97e-4c95-8ee1-832d8b2d3ff3 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-38602208" status: 404 len: 97 microversion: 2.1 time: 0.575004 Aug 11 16:27:56.870973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 4/6] 10.222.0.43 () {58 vars in 1212 bytes} [Thu Aug 11 16:27:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-38602208 => generated 97 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 11 16:27:56.879134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4761b947-7a86-49ed-8f7b-574f86a25028 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004041 Aug 11 16:27:56.880249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1140 bytes} [Thu Aug 11 16:27:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 16:27:56.892818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-993d7e22-679c-4592-9923-cdc129c2c056 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007009 Aug 11 16:27:56.894114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1137 bytes} [Thu Aug 11 16:27:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 16:27:56.906759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c1598fa1-fc85-4248-b33c-24d0303476ab tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Calling method '.version_select at 0x7f61493ca5e0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:56.964268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-c1598fa1-fc85-4248-b33c-24d0303476ab tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] HTTP exception thrown: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c1598fa1-fc85-4248-b33c-24d0303476ab tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/os-volumes/848a254d-f717-47f0-b9d7-8f570e3a6324 HTTP/1.1 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:27:56.969398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '848a254d-f717-47f0-b9d7-8f570e3a6324'} Aug 11 16:27:56.970730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. (HTTP 404) (Request-ID: req-47149fb1-379a-4916-b7f1-cbb3b3160086) Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.971561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:27:56.972723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 16:27:56.973817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. Aug 11 16:27:56.975113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:27:56.977047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c1598fa1-fc85-4248-b33c-24d0303476ab tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 404 to user: Volume 848a254d-f717-47f0-b9d7-8f570e3a6324 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:56.978740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c1598fa1-fc85-4248-b33c-24d0303476ab tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/848a254d-f717-47f0-b9d7-8f570e3a6324" status: 404 len: 109 microversion: 2.1 time: 0.077147 Aug 11 16:27:56.982504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:27:56 2022] DELETE /compute/v2.1/os-volumes/848a254d-f717-47f0-b9d7-8f570e3a6324 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:27:56.994988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8badbc6-f663-4dac-bb35-2a791d5aa897 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Calling method '.version_select at 0x7f6149342af0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:57.051451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-f8badbc6-f663-4dac-bb35-2a791d5aa897 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] HTTP exception thrown: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8badbc6-f663-4dac-bb35-2a791d5aa897 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Request method failure captured: Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/os-volumes/a90afb55-c34f-48ee-b920-b65cd0038b9e HTTP/1.1 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4KPcRZeAdmARam1XAOlsauhH7aSeLobMeM2ltPNu9jtu9VQ2iTSKApJJvDEk2SYf2e7Y8ZsghBB7zMMzM-ts_tn4kRJXwGv1K3tL10hr_tSeXXMVPa86VRYkjX9CpSD-NrUJERHEojNgRKV-vpW8K75k0R5dtOq0-gP4VIFH7Z_AE Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:27:57.053501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1882257ce68f4b75b18946c697816ef7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1882257ce68f4b75b18946c697816ef7"}]}] Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 1882257ce68f4b75b18946c697816ef7 Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesNegativeTest-726182488 Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3de4765f3004489b853e855337da820c Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesNegativeTest-726182488-project Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'a90afb55-c34f-48ee-b920-b65cd0038b9e'} Aug 11 16:27:57.054836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. (HTTP 404) (Request-ID: req-43457367-0797-45ce-9477-e754a995a62b) Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:57.057800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:27:57.059591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 16:27:57.060746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8badbc6-f663-4dac-bb35-2a791d5aa897 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] Returning 404 to user: Volume a90afb55-c34f-48ee-b920-b65cd0038b9e could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f8badbc6-f663-4dac-bb35-2a791d5aa897 tempest-VolumesNegativeTest-726182488 tempest-VolumesNegativeTest-726182488-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a90afb55-c34f-48ee-b920-b65cd0038b9e" status: 404 len: 109 microversion: 2.1 time: 0.070136 Aug 11 16:27:57.064279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:27:56 2022] GET /compute/v2.1/os-volumes/a90afb55-c34f-48ee-b920-b65cd0038b9e => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:27:57.673346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d0ad2d94-a2bb-4412-a686-85e528d4b537 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61493364c0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:57.749484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d0ad2d94-a2bb-4412-a686-85e528d4b537 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 200 len: 346 microversion: 2.1 time: 0.083207 Aug 11 16:27:57.750371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 5/11] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:27:57 2022] GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:27:57.763055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-044ab93f-b3e0-46d6-948b-98d14007b890 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Action: 'create', calling method: .version_select at 0x7f6149342b80>, body: {"snapshot": {"volume_id": "2b4337fa-5813-4596-b776-1612607b505f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1816510306"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:27:58.145793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-044ab93f-b3e0-46d6-948b-98d14007b890 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.386832 Aug 11 16:27:58.146669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 7/12] 10.222.0.43 () {60 vars in 1162 bytes} [Thu Aug 11 16:27:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:27:58.158222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e259a56-4c47-4a03-9cdd-84cae28be7f9 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149336b80>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:58.210060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e259a56-4c47-4a03-9cdd-84cae28be7f9 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 287 microversion: 2.1 time: 0.055736 Aug 11 16:27:58.210755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 6/13] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:27:58 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:27:58.223371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ac62433-8bfe-48e8-8c47-1e1e54a61e29 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f614935ca60>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:58.334879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ac62433-8bfe-48e8-8c47-1e1e54a61e29 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.115285 Aug 11 16:27:58.336872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 8/14] 10.222.0.43 () {58 vars in 1140 bytes} [Thu Aug 11 16:27:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:27:58.347834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-81d5348f-2eee-4044-bfa9-1eb57feb2db3 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149336c10>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:58.405685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-81d5348f-2eee-4044-bfa9-1eb57feb2db3 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 287 microversion: 2.1 time: 0.061680 Aug 11 16:27:58.406518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:27:58 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:27:59.420571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f58a4515-54da-4d5e-852a-6d59527f0a2f tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149342670>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:27:59.559317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f58a4515-54da-4d5e-852a-6d59527f0a2f tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 287 microversion: 2.1 time: 0.143415 Aug 11 16:27:59.560092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:27:59 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:00.572865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-83793ea8-09c1-4754-975b-2be5c118cd2c tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61493364c0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:00.632443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-83793ea8-09c1-4754-975b-2be5c118cd2c tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 287 microversion: 2.1 time: 0.064163 Aug 11 16:28:00.637557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:28:00 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:01.645479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ad912c65-4faf-4b5d-a915-c9b8a7f6506f tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149342c10>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:01.774566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ad912c65-4faf-4b5d-a915-c9b8a7f6506f tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 288 microversion: 2.1 time: 0.132990 Aug 11 16:28:01.781068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 10/18] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:28:01 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 288 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:01.786208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-11d4cc5d-e0dd-4d98-aa51-b0bd313baae9 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f614933e3a0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:01.939035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-11d4cc5d-e0dd-4d98-aa51-b0bd313baae9 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 202 len: 0 microversion: 2.1 time: 0.156645 Aug 11 16:28:01.940052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 9/19] 10.222.0.43 () {58 vars in 1254 bytes} [Thu Aug 11 16:28:01 2022] DELETE /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:28:01.949278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a840ab0-93b0-455a-af97-9fb24beff2a3 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61494268b0>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:02.016252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a840ab0-93b0-455a-af97-9fb24beff2a3 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 200 len: 287 microversion: 2.1 time: 0.071874 Aug 11 16:28:02.021217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:28:01 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:03.035502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dab05777-169d-4ba8-8560-1f8cd95b8fce tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61493364c0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:03.121840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-dab05777-169d-4ba8-8560-1f8cd95b8fce tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] HTTP exception thrown: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dab05777-169d-4ba8-8560-1f8cd95b8fce tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Request method failure captured: Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb HTTP/1.1 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4JHhWJpw4pi9VA1d2k0vWZ22A0lDToozqHesQDW4ok23I7k2Ebt82AiArBkuibYfDxy5WClJ6Qtt7q7i7IR8oo-nMnFHyfthyUNGJ1b8MQ5r1pi-Ec5PCezLASG0sTlDqVRS7Lf41xVAzeoSAzsH7kfUQDL9vCZm7aP2cr0NgG2jE Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:28:03.124203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7c413ee4c438ab8223b42a3a5f692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}] Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: aa6eadb8625649e29ef26b437fe81a39 Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'd9af8aa5-90ce-4c96-8f05-9f5ddc2030fb'} Aug 11 16:28:03.125317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. (HTTP 404) (Request-ID: req-d6223f9f-90ee-46b7-ade2-41885b966ef1) Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.125967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.127474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 11 16:28:03.128380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dab05777-169d-4ba8-8560-1f8cd95b8fce tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Returning 404 to user: Snapshot d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:28:03.130706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dab05777-169d-4ba8-8560-1f8cd95b8fce tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb" status: 404 len: 111 microversion: 2.1 time: 0.095413 Aug 11 16:28:03.134973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 10/21] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 16:28:03 2022] GET /compute/v2.1/os-snapshots/d9af8aa5-90ce-4c96-8f05-9f5ddc2030fb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:28:03.145754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6c43fd7e-fdd1-4cbd-abe0-40d35a9a2c44 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f614933e5e0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:03.394036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6c43fd7e-fdd1-4cbd-abe0-40d35a9a2c44 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 202 len: 0 microversion: 2.1 time: 0.257539 Aug 11 16:28:03.394590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 11/22] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:28:03 2022] DELETE /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:28:03.404130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-336650ad-1c46-4f26-8c14-8c739500543a tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149336700>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:03.504832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02b47d12-86c3-4798-9dab-75a5f32ddd58 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'create', calling method: .version_select at 0x7f61494268b0>, body: {"keypair": {"name": "tempest-keypair-722919124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9XF/W5RGcjPCEsXqsHnof39O/GCY5QOSKgW/w4TSokpeOFRw6byyD2SAlfktiZ+eF98AkdNZUqsUxu0jgL6AgyMqluZf0r6gH3lrGdwByslziVSzGvsd6agowwQLS4+Q=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:03.621403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-336650ad-1c46-4f26-8c14-8c739500543a tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] HTTP exception thrown: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-336650ad-1c46-4f26-8c14-8c739500543a tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Request method failure captured: Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f HTTP/1.1 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4JHhWJpw4pi9VA1d2k0vWZ22A0lDToozqHesQDW4ok23I7k2Ebt82AiArBkuibYfDxy5WClJ6Qtt7q7i7IR8oo-nMnFHyfthyUNGJ1b8MQ5r1pi-Ec5PCezLASG0sTlDqVRS7Lf41xVAzeoSAzsH7kfUQDL9vCZm7aP2cr0NgG2jE Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:28:03.623574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7c413ee4c438ab8223b42a3a5f692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}] Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: aa6eadb8625649e29ef26b437fe81a39 Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '2b4337fa-5813-4596-b776-1612607b505f'} Aug 11 16:28:03.624933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. (HTTP 404) (Request-ID: req-9954a574-4e01-4bfa-87e1-59cf6c3e5ff7) Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.625751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.626850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 16:28:03.627953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.629121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.630298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-336650ad-1c46-4f26-8c14-8c739500543a tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Returning 404 to user: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:28:03.631658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-336650ad-1c46-4f26-8c14-8c739500543a tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 404 len: 109 microversion: 2.1 time: 0.232392 Aug 11 16:28:03.632730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:03 2022] GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 109 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:28:03.649406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b685e7eb-0770-41de-bc5f-a3abccc18c06 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f61493cae50>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:03.650565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-02b47d12-86c3-4798-9dab-75a5f32ddd58 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for project 6d15983e6d8e4ad6887105f88f187044. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:03.677165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-02b47d12-86c3-4798-9dab-75a5f32ddd58 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for user 3a5ab962b58f473f874bd94bfe2db6b3 and project 6d15983e6d8e4ad6887105f88f187044. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:03.703678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-b685e7eb-0770-41de-bc5f-a3abccc18c06 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] HTTP exception thrown: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b685e7eb-0770-41de-bc5f-a3abccc18c06 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Request method failure captured: Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f HTTP/1.1 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4JHhWJpw4pi9VA1d2k0vWZ22A0lDToozqHesQDW4ok23I7k2Ebt82AiArBkuibYfDxy5WClJ6Qtt7q7i7IR8oo-nMnFHyfthyUNGJ1b8MQ5r1pi-Ec5PCezLASG0sTlDqVRS7Lf41xVAzeoSAzsH7kfUQDL9vCZm7aP2cr0NgG2jE Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:28:03.706037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7c413ee4c438ab8223b42a3a5f692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}] Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: aa6eadb8625649e29ef26b437fe81a39 Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '2b4337fa-5813-4596-b776-1612607b505f'} Aug 11 16:28:03.707096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. (HTTP 404) (Request-ID: req-5ba1ccef-8df1-46f0-980b-3c57da73facb) Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.707736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 16:28:03.708962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 16:28:03.710193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b685e7eb-0770-41de-bc5f-a3abccc18c06 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Returning 404 to user: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b685e7eb-0770-41de-bc5f-a3abccc18c06 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 404 len: 109 microversion: 2.1 time: 0.064994 Aug 11 16:28:03.712740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:28:03 2022] DELETE /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:28:03.719252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80c50d51-d564-4637-a55f-e358fd01d5a1 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Calling method '.version_select at 0x7f6149336d30>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:03.783427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02b47d12-86c3-4798-9dab-75a5f32ddd58 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.660792 Aug 11 16:28:03.784364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 12/25] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:28:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:03.801173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-80c50d51-d564-4637-a55f-e358fd01d5a1 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] HTTP exception thrown: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80c50d51-d564-4637-a55f-e358fd01d5a1 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Request method failure captured: Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f HTTP/1.1 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4JHhWJpw4pi9VA1d2k0vWZ22A0lDToozqHesQDW4ok23I7k2Ebt82AiArBkuibYfDxy5WClJ6Qtt7q7i7IR8oo-nMnFHyfthyUNGJ1b8MQ5r1pi-Ec5PCezLASG0sTlDqVRS7Lf41xVAzeoSAzsH7kfUQDL9vCZm7aP2cr0NgG2jE Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:28:03.807231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_82d7c413ee4c438ab8223b42a3a5f692", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/82d7c413ee4c438ab8223b42a3a5f692"}]}] Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 82d7c413ee4c438ab8223b42a3a5f692 Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2122735662 Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: aa6eadb8625649e29ef26b437fe81a39 Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2122735662-project Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '2b4337fa-5813-4596-b776-1612607b505f'} Aug 11 16:28:03.808694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. (HTTP 404) (Request-ID: req-9b86a9f7-8069-443e-a589-7fb93155c916) Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.809539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:03.810676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 16:28:03.811839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:03.813251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80c50d51-d564-4637-a55f-e358fd01d5a1 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] Returning 404 to user: Volume 2b4337fa-5813-4596-b776-1612607b505f could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:28:03.814956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-80c50d51-d564-4637-a55f-e358fd01d5a1 tempest-VolumesSnapshotsTestJSON-2122735662 tempest-VolumesSnapshotsTestJSON-2122735662-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f" status: 404 len: 109 microversion: 2.1 time: 0.099876 Aug 11 16:28:03.815621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:03 2022] GET /compute/v2.1/os-volumes/2b4337fa-5813-4596-b776-1612607b505f => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:28:09.316021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3bd1b163-9025-44b2-860e-ef12f8cdecb8 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Action: 'create', calling method: .version_select at 0x7f61492bb430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-350167856", "metadata": {"Type": "work"}}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:09.853404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3bd1b163-9025-44b2-860e-ef12f8cdecb8 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.977985 Aug 11 16:28:09.855158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 13/27] 10.222.0.43 () {60 vars in 1156 bytes} [Thu Aug 11 16:28:08 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 980 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 11 16:28:09.866758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02f80fc8-25f9-4115-b132-2d347d6fbabf tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f614933e430>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:09.942342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02f80fc8-25f9-4115-b132-2d347d6fbabf tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 200 len: 352 microversion: 2.1 time: 0.079158 Aug 11 16:28:09.942973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:09 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:10.237791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1383137832", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97b922f2-8007-4606-ab93-3e8f9ba65cd9"}], "security_groups": [{"name": "tempest-securitygroup--1619908090"}], "key_name": "tempest-keypair-722919124", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:10.768444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] validate_networks() for [('97b922f2-8007-4606-ab93-3e8f9ba65cd9', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:10.959855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-78a33480-aed2-45b3-9351-defa71d1cd50 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f6149336430>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:11.106808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-78a33480-aed2-45b3-9351-defa71d1cd50 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 200 len: 352 microversion: 2.1 time: 0.150987 Aug 11 16:28:11.118992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:10 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 352 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:12.121492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4d3cf21-fc5e-4b7d-bfc8-2fcc25c3962e tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f614944ad30>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:12.224962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4d3cf21-fc5e-4b7d-bfc8-2fcc25c3962e tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 200 len: 353 microversion: 2.1 time: 0.107580 Aug 11 16:28:12.225688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 17/30] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:12 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:12.248889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-45c7d646-4c98-46c0-849e-2f57b31213cc tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f614933e0d0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:12.449514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-45c7d646-4c98-46c0-849e-2f57b31213cc tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 200 len: 353 microversion: 2.1 time: 0.214430 Aug 11 16:28:12.456394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 18/31] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:12 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:12.469373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3dae4993-9124-45fb-a563-9d46b140cd7c tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f614933e040>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:12.714626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3dae4993-9124-45fb-a563-9d46b140cd7c tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 202 len: 0 microversion: 2.1 time: 0.248976 Aug 11 16:28:12.716524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 19/32] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:28:12 2022] DELETE /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 16:28:12.724842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-be18225d-d90c-428e-95c2-08a88abb2064 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f6149336820>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:12.958494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-be18225d-d90c-428e-95c2-08a88abb2064 tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 200 len: 352 microversion: 2.1 time: 0.237762 Aug 11 16:28:12.959635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 20/33] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:12 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 352 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:13.708610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:13.942960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:13.944595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:13.945777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:13.946437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:13.947001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:13.972324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:13.972757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:13.974922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-83605ec4-6ee8-47af-915e-e32205e2373d tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Calling method '.version_select at 0x7f61493368b0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:13.979702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:13.981450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:13.982622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:13.983063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:14.040971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-83605ec4-6ee8-47af-915e-e32205e2373d tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] HTTP exception thrown: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-83605ec4-6ee8-47af-915e-e32205e2373d tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Request method failure captured: Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c HTTP/1.1 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4YZe5Y9JkQig7TDEUSGjqOy82Wetgc9-CAcONlqqImhV1XkcN1cvssvkmn94L9k2WQ52Rhv125_xQzCuOS1BZ3-9GHb5F6lbTLpDv4ereT6sR4wMIr2oVcmCOVESn5rjrhEFDTNqVGwI625dRT3_2gAw-ozVgj1WuXQkLWjf0-ZnY Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 9e9fa6fe84f547158ac0190fcb386663 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesGetTestJSON-1343437545 Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:28:14.043307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9e9fa6fe84f547158ac0190fcb386663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e9fa6fe84f547158ac0190fcb386663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9e9fa6fe84f547158ac0190fcb386663", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9e9fa6fe84f547158ac0190fcb386663"}]}] Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesGetTestJSON-1343437545 Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 9e9fa6fe84f547158ac0190fcb386663 Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesGetTestJSON-1343437545 Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesGetTestJSON-1343437545-project Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 6c43afa2ed154b27bb186d4aa1912f82 Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesGetTestJSON-1343437545-project Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'ca808895-7073-49d8-86c0-f2aed111489c'} Aug 11 16:28:14.044685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. (HTTP 404) (Request-ID: req-e8c2cd40-abb3-4530-901e-89ed6f98767a) Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:14.045491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 16:28:14.046595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 16:28:14.047670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. Aug 11 16:28:14.048858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:28:14.049771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-83605ec4-6ee8-47af-915e-e32205e2373d tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] Returning 404 to user: Volume ca808895-7073-49d8-86c0-f2aed111489c could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:28:14.050883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-83605ec4-6ee8-47af-915e-e32205e2373d tempest-VolumesGetTestJSON-1343437545 tempest-VolumesGetTestJSON-1343437545-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c" status: 404 len: 109 microversion: 2.1 time: 0.081418 Aug 11 16:28:14.051634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 21/34] 10.222.0.43 () {58 vars in 1245 bytes} [Thu Aug 11 16:28:13 2022] GET /compute/v2.1/os-volumes/ca808895-7073-49d8-86c0-f2aed111489c => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:28:14.067533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for project 6d15983e6d8e4ad6887105f88f187044. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:14.087556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for user 3a5ab962b58f473f874bd94bfe2db6b3 and project 6d15983e6d8e4ad6887105f88f187044. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:14.116547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:14.120446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:14.305635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-25b4bb56-add0-4c5f-9d7b-248939bc3c38 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.073789 Aug 11 16:28:14.317951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 14/35] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:28:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 4087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:28:14.319651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f6d58b2c-1571-4471-bb46-65125cd0ab20 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:14.321864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f6d58b2c-1571-4471-bb46-65125cd0ab20 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:14.725155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f6d58b2c-1571-4471-bb46-65125cd0ab20 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:14.763287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f6d58b2c-1571-4471-bb46-65125cd0ab20 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1237 microversion: 2.1 time: 0.447737 Aug 11 16:28:14.766745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 22/36] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:14 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1237 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:15.338900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc8060b8-3dd3-45d8-95c2-78a22c9ccf35 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'create', calling method: .version_select at 0x7f6148a0b550>, body: {"keypair": {"name": "tempest-keypair-1266333986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFHAycQd2w3hMi7yctAEr71v0RQ11b5E60YRc0IJl56Kw3s0VBos2hQbdNDqqo6+K/s3NpinQvGFNivvEZI8fBggwxZBU2Hatje8soLWEZw2rq5seKA9XvtKY2uPZcr9Q=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:15.380637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bc8060b8-3dd3-45d8-95c2-78a22c9ccf35 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:15.395359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bc8060b8-3dd3-45d8-95c2-78a22c9ccf35 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for user 60ee85a52c0244879f10e8943d20dfb8 and project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:15.458665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc8060b8-3dd3-45d8-95c2-78a22c9ccf35 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.772483 Aug 11 16:28:15.460372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 15/37] 10.222.0.43 () {62 vars in 1200 bytes} [Thu Aug 11 16:28:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 775 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 16:28:15.521570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1899192563", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:15.668272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] validate_networks() for [('b75ec96a-f925-4d74-8dce-3e38b63dd050', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:15.788190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-896f9c03-2c97-49a5-8709-3cf3ede0548b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:15.788384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-896f9c03-2c97-49a5-8709-3cf3ede0548b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:16.235209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-896f9c03-2c97-49a5-8709-3cf3ede0548b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:16.261623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-896f9c03-2c97-49a5-8709-3cf3ede0548b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1237 microversion: 2.1 time: 0.479815 Aug 11 16:28:16.262225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 16/38] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:15 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1237 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:17.288055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:17.289982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:17.309263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:17.313642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:17.328262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:17.329373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:17.329676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:17.332046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:17.740452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:17.762160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7d19a72f-3aeb-4167-acbe-f3d07b1f4108 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1241 microversion: 2.1 time: 0.481786 Aug 11 16:28:17.767043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 17/39] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:17 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1241 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:18.255602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-03ae2140-6d7a-48c2-833e-ece409a5b706 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: .version_select at 0x7f614814ef70>, body: {"keypair": {"name": "tempest-keypair-1099645941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyI0gHN9l/JD5vmPnFck5JyIJi6aFAiNEW96Ec1CVk7Z8eX2EJY5iOVkWpwlyOvrMNigoKTQnSzu7hmAMuGiXIRlWFPk/CQO36M9v4AHu6u+7KBZ4IFv6lMZEBY2piwmw=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:18.292806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-03ae2140-6d7a-48c2-833e-ece409a5b706 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:18.300421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-03ae2140-6d7a-48c2-833e-ece409a5b706 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:18.368687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-03ae2140-6d7a-48c2-833e-ece409a5b706 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.600320 Aug 11 16:28:18.370892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 18/40] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:28:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:18.720431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:18.720970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:18.722801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:18.723228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:18.723932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:18.768995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:18.769480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:18.770055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:18.770843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:18.771300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:18.771806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:18.792619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:18.793247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:18.814495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:18.817140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:18.817967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:18.822730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:18.824500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:18.824970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:18.902466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:18.917340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for user 5d59680b3fde47bf81c7765ca4d8a757 and project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:18.947542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:18.951623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:19.060733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:19.068933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9fe4bd3-fb53-434d-90b3-c52ff847dec1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1295 microversion: 2.1 time: 0.286839 Aug 11 16:28:19.070739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 19/41] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:18 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1295 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:19.140501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b6c2cb19-43b4-4882-ac64-6d676e0678eb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.718463 Aug 11 16:28:19.142710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 23/42] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:28:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 16:28:19.155426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1ef8dbb-8561-4f51-9105-753632729577 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:19.156598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1ef8dbb-8561-4f51-9105-753632729577 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:19.463985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1ef8dbb-8561-4f51-9105-753632729577 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:19.477463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1ef8dbb-8561-4f51-9105-753632729577 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1222 microversion: 2.1 time: 0.326766 Aug 11 16:28:19.478173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:19 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:20.060540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1235302832", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:20.166553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] validate_networks() for [('b75ec96a-f925-4d74-8dce-3e38b63dd050', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:20.540186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1253496106", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "networks": [{"uuid": "cd262398-4d4b-45ef-8551-b4ee02ad9491"}]}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:20.733605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] validate_networks() for [('cd262398-4d4b-45ef-8551-b4ee02ad9491', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:22.136423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:22.137462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:22.137462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:22.137895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:22.138287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:22.157747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:22.159621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:22.162141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:22.166321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:22.176498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:22.182654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:22.250458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:22.264523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for user 5d59680b3fde47bf81c7765ca4d8a757 and project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:22.306909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:22.309225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:22.445598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f29d2d0b-319b-4ced-803d-ec75d07351f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.388743 Aug 11 16:28:22.456624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 21/44] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:28:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:28:22.462583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:22.463460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:22.497994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:22.497994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:22.497994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:22.499122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:22.503305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:22.504032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:22.729013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:22.736644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f97793fa-285a-41a4-8449-76b2fc9de6d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1295 microversion: 2.1 time: 0.278598 Aug 11 16:28:22.750773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 22/45] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:22 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1295 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:22.753495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b70982e8-0caf-414c-a125-2c68f17ac33b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:22.754528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b70982e8-0caf-414c-a125-2c68f17ac33b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:23.150572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b70982e8-0caf-414c-a125-2c68f17ac33b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:23.172148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b70982e8-0caf-414c-a125-2c68f17ac33b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1222 microversion: 2.1 time: 0.421455 Aug 11 16:28:23.173054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 23/46] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:22 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1222 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:23.763278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:23.763902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:23.772113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:23.773723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:23.773723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:23.774347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:23.774802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:23.775230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:24.620705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:24.621801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:24.623123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:24.623656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:24.624147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:24.652627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:24.653117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:24.653553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:24.659507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:24.661891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:24.662434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:24.738768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Getting quotas for project 77b79bd8e6b84cd3a082d80b4aa3a546. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:24.759197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Getting quotas for user eca40eca0b6140a498e034e3e37a8c47 and project 77b79bd8e6b84cd3a082d80b4aa3a546. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:24.789356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:24.791548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:24.921509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff0c1022-ea36-451d-9ed8-40f3f4c5e9ba tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.146600 Aug 11 16:28:24.922545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 5149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:28:24.938564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:24.939192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:24.949353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:24.957592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:24.958150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:24.959106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:24.959731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:24.960630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:25.412144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:25.448323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a6174986-fbe5-4f8d-95e2-9a64a6365b24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1274 microversion: 2.1 time: 0.516680 Aug 11 16:28:25.462894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:24 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1274 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:25.462894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff4be300-076e-418b-9768-5caebffdc1bc tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:25.468724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff4be300-076e-418b-9768-5caebffdc1bc tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:26.144823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff4be300-076e-418b-9768-5caebffdc1bc tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:26.156318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff4be300-076e-418b-9768-5caebffdc1bc tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1215 microversion: 2.1 time: 0.701428 Aug 11 16:28:26.162196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 26/49] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:25 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1215 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:26.189349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1683010996", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e733066a-89a4-41d8-b60f-23e6365a8bd8"}], "security_groups": [{"name": "tempest-securitygroup--1441781654"}], "key_name": "tempest-keypair-1266333986", "user_data": "}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:26.408524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:26.447027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f6c45c5c-380e-41ea-97b7-61624ce6b3b8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 2.687394 Aug 11 16:28:26.448743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 24/50] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:23 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:26.470967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:26.471836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:26.521474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:26.523221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:26.547583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:26.550016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:26.551013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:26.556638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:26.557118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:26.993738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:27.023759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cb9ed99d-9ef6-4953-945f-7fc55229af98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1280 microversion: 2.1 time: 0.541897 Aug 11 16:28:27.027635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 25/51] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:26 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:27.178977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:27.179856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:27.191644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:27.193285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:27.194076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:27.201074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:27.201649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:27.202748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:27.692919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:27.715756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49e78c58-ac74-43a8-909d-c8aa98c31f44 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1211 microversion: 2.1 time: 0.533051 Aug 11 16:28:27.717053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 26/52] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:27 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1211 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:27.756656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:27.758283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:27.768869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] validate_networks() for [('e733066a-89a4-41d8-b60f-23e6365a8bd8', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:27.775687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:27.782256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:27.783188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:27.785852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:27.787452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:27.789381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:28.812380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:28.823186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7d4273ba-fdc9-407f-b9e4-29a16b53a12a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 1.083426 Aug 11 16:28:28.827536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:27 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:28.835826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-160098983", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247ee74-ce66-47ac-ae21-9c4793c44289"}], "security_groups": [{"name": "tempest-securitygroup--1971492733"}], "key_name": "tempest-keypair-1099645941", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:29.093876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] validate_networks() for [('6247ee74-ce66-47ac-ae21-9c4793c44289', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:28:31.262105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:31.263598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:31.264279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:31.264877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:31.265456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:31.282290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.282950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.285260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.286206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.296648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.297435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.329909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:31.340074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:31.367745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:31.375297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:31.474219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bce8cf6d-15c7-4c7e-a99c-f7a99f61a15b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.645322 Aug 11 16:28:31.475191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 28/54] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:28:31.483361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:31.485107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:31.498957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.499714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.502112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.503029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.503976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.506066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.635037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:31.643454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d9f045d-5556-498c-8f3f-30e1243c0f54 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1280 microversion: 2.1 time: 0.166140 Aug 11 16:28:31.644045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 29/55] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:31 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:31.661577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:31.662504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:31.676646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.677897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.678403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.685425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.690339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.690805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.737764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:28:31.738383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:28:31.738864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:28:31.739265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:28:31.739682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:28:31.758447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.762189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.762778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.766510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.767047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.767488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.824696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:28:31.830387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:31.836086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for user 60ee85a52c0244879f10e8943d20dfb8 and project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:28:31.840308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c1a780c7-8c47-4943-ad30-17dbf9f80ade tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1273 microversion: 2.1 time: 0.191047 Aug 11 16:28:31.840893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 30/56] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:31 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:31.847108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:31.847897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:31.854968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.855927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.856682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.857841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:31.858574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:31.859259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:31.866035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:28:31.869142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:28:31.932066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3648918b-8e7d-49a1-99df-57fb58369455 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.767956 Aug 11 16:28:31.933085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 27/57] 10.222.0.43 () {62 vars in 1188 bytes} [Thu Aug 11 16:28:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 5770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 11 16:28:32.159668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.178564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a29c40b8-4b19-4665-9fe3-3293474ed694 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.334594 Aug 11 16:28:32.179489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 31/58] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:31 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:32.196846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f07dc531-81ed-4781-91d1-c3a93ca1e7a5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:32.197667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f07dc531-81ed-4781-91d1-c3a93ca1e7a5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:32.338308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f07dc531-81ed-4781-91d1-c3a93ca1e7a5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.349267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f07dc531-81ed-4781-91d1-c3a93ca1e7a5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1241 microversion: 2.1 time: 0.163773 Aug 11 16:28:32.351637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:32 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:32.379023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:32.380086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:32.473035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad28131-4298-4448-bdb8-74313c3bf525", "tag": "d092b0e0-4c57-4a25-b642-5a3ba8e66bf6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:32.481559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.499713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.501353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.504867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.506215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.509521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.512493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cab2ab2b-2640-47fd-b2c4-7a80faab853e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1282 microversion: 2.20 time: 0.158220 Aug 11 16:28:32.523636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 33/60] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:32.556052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Creating event network-changed:d092b0e0-4c57-4a25-b642-5a3ba8e66bf6 for instance aad28131-4298-4448-bdb8-74313c3bf525 on hv-cinder-85220 Aug 11 16:28:32.557125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 16:28:32.557558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9aaf18a0-be40-48c6-a6b1-6be32b111b4a req-5f2806a3-f733-4c91-bf69-08a8706fcb46 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 16:28:32.558719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.559225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.559910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.560853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.561294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.562015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.573048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.compute.rpcapi [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 16:28:32.574422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] Releasing lock "compute-rpcapi-router" {{(pid=120730) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 16:28:32.637515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-20773f27-8cad-4fdc-9fb1-2ffb979c1224 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702960 Aug 11 16:28:32.639518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 28/61] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:32.666105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:32.666837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:32.687409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.687409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.688271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.689122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.689867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.690818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.874442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:32.875161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:32.894853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.895353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.923198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.924259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:32.924897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:32.925480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:32.935319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:32.949071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e360284d-4cda-4bca-80d8-59763096d7af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1280 microversion: 2.1 time: 0.287011 Aug 11 16:28:32.964420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 34/62] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:32 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:33.200198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:33.200816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:33.213766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.214261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.214699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.226510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.227014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.227463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.407376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:33.415564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-21f00ac3-de77-4583-9a25-b083d06e8f03 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.219714 Aug 11 16:28:33.416468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 35/63] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:33 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:33.421634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:33.423066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:33.439469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.439964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.440444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.441152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.441605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.442049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.510494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:33.525024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:33.535360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9f03825e-6843-4119-a7cd-280682b15a94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1245 microversion: 2.1 time: 0.117350 Aug 11 16:28:33.535604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-28a1e7f4-e245-4fd0-9db6-8815cde4b7ff tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1273 microversion: 2.1 time: 0.672818 Aug 11 16:28:33.539703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 29/64] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:32 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1273 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:33.545512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 36/65] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:33 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:33.570501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:33.573306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:33.591256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.591508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.603478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.604260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.606994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.607619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.970817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:33.971434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:33.980662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.983038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.983038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:33.983038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:33.988954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:33.991687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:34.184845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:34.205421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:34.208686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:34.212398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fc9fd24e-fef1-4b96-a989-fd358b72dd4b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1286 microversion: 2.20 time: 0.664418 Aug 11 16:28:34.213737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 30/66] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1286 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:34.629717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fca7c34-392f-431f-8ba3-191be7a54e10", "tag": "6a27283a-4da4-4638-bff4-70f79f256e03"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:34.666710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:34.667271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:34.670848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:34.707616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] Creating event network-changed:6a27283a-4da4-4638-bff4-70f79f256e03 for instance 7fca7c34-392f-431f-8ba3-191be7a54e10 on hv-cinder-85220 Aug 11 16:28:34.717004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-113dc334-6c28-430c-98db-29b57da85bfd req-83416865-2499-4eca-9fa5-33e6e627943f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501704 Aug 11 16:28:34.721219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 31/67] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:34.739362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:34.743121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:34.755783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:34.758285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:34.759733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:34.760953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:34.766394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:34.767360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.088260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:35.098870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95466a4b-4015-4fe5-9f2c-22236b707195 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 1.129048 Aug 11 16:28:35.101014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 37/68] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:33 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:35.123081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:35.124227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:35.148053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.148624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.149161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.157421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.163989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.166550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.418779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:35.429532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-53779e63-fc61-4191-94dd-38bfb3481169 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.326173 Aug 11 16:28:35.435947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 38/69] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:35 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:35.454827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:35.455966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:35.465150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.466451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.467087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.468069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.468998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.469656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.496711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:35.831284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:35.871374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30eea01e-fc4b-4249-af82-a039aa9d64b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1293 microversion: 2.1 time: 0.432002 Aug 11 16:28:35.878062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 39/70] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:35 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1293 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:35.891324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:35.891970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:35.908414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.911012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.911988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:35.917014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:35.918390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:35.922360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.143760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:36.164841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:36.173049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:36.176732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0678c00d-a663-4d3b-adb3-9ca88b3342e6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1334 microversion: 2.20 time: 0.297619 Aug 11 16:28:36.177313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 40/71] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1334 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:36.193467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:36.197750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:36.227956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.230436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.236275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.237887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.241189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.242680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.467100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:36.476639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-254b1747-dc38-4bfb-ab8a-70d974908253 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 1.753657 Aug 11 16:28:36.488637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 32/72] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:34 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:36.505638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:36.519871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:36.552832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.565725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.566307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.570042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.570522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.577596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.846642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:36.861597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-25667f4a-463a-404c-b7bd-53d88108469b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.676739 Aug 11 16:28:36.875359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 41/73] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:36 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:36.901959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:36.902878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:36.914736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.918390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.919154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:36.920561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:36.921246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:36.921898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.073655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.090970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae81a6e1-b149-465c-af04-c31bc0f03ed6 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.195689 Aug 11 16:28:37.093473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 42/74] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:36 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:37.205847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:37.207102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:37.221282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.227509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.228224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.229182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.230335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.234426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.380683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.395243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.398732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.403177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e83555bf-ff4e-4304-a911-ac91c3ceba3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1340 microversion: 2.20 time: 0.201048 Aug 11 16:28:37.403914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 43/75] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:28:37.510877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:37.511477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:37.519277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.519997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.520602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.521693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.523128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.523797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.731064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.740214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-088d6a6d-2950-4e14-bec3-f4b2307fc7bf tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 1.243617 Aug 11 16:28:37.740818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 33/76] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:36 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:37.748147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:37.760530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7efe3fec-f144-4972-9250-8a5d575aece0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.254296 Aug 11 16:28:37.767511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 44/77] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:37 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:37.882078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:37.883140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:37.898196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.898712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.899157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:37.899898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:37.900399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:37.900824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.119845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:38.120571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:38.138025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.138524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.138959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.140351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.141035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.141636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.239549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.248901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79224f53-0139-45ff-9021-9c5978fa1d6c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.134000 Aug 11 16:28:38.249894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 45/78] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:38 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:38.355549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.364263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d2e2f0a0-33e1-4250-8401-173338d7d5a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.486477 Aug 11 16:28:38.364852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 34/79] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:37 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:38.432008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:38.435710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:38.439070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cff93e-cea6-4a7e-92ce-c2f0990edc7e", "tag": "815de520-05d9-494f-9457-2930d19312ed"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:38.447909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.449242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.450585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.451661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.452874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.455060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.455375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.456936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.458528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.477712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] Creating event network-changed:815de520-05d9-494f-9457-2930d19312ed for instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e on hv-cinder-85220 Aug 11 16:28:38.483749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-27bd0750-0a1f-4eb5-bb35-198c68b346e1 req-37c0d590-d0da-439d-b475-2f416f5d21e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050210 Aug 11 16:28:38.484697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 35/80] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:38.548765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.557398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.559003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.560234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa85f762-1a33-44fc-849a-9f07ed69fe53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1340 microversion: 2.20 time: 0.135939 Aug 11 16:28:38.561096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 46/81] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1340 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:38.762133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:38.762826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:38.769407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.770071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.770302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.770990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.771434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.771851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.802774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:38.805403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:38.818090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.818717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.819671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.820842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:38.821414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:38.822928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:38.991033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:38.998657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3919980a-a81d-4f40-b1a3-497962c4af34 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.216841 Aug 11 16:28:38.999376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 47/82] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:38 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:39.047774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.061992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-405dc4b5-d7c7-4857-91a2-7d7c4c18276b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.303897 Aug 11 16:28:39.062721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 36/83] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:38 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:39.279285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:39.280712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:39.287202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.288874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.289484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.290396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.291164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.291733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.385508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:39.386038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:39.394684 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.395177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.395611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.395838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.396340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.396792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.397536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.407327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4b19a57-02fd-44c6-9fbd-2d5816ca1e87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.139997 Aug 11 16:28:39.408832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 48/84] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:39 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:39.589799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:39.590513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:39.601737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.601928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.602528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.603143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.614065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:39.615774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:39.616073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b5f25179-a28f-4136-9783-abfea733e17a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.234622 Aug 11 16:28:39.619784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 37/85] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:39 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:39.630618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:39.729617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.740508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.743549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:39.745044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8718d1aa-78ba-4fb9-beb5-85ffad36a71e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1340 microversion: 2.20 time: 0.162533 Aug 11 16:28:39.760573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 49/86] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:40.019778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:40.020936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:40.032308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.033140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.033737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.034611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.035496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.036264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.089548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:40.090234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:40.108631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.113100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.113762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.115444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.116908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.119157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.297304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.310673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82587121-4416-43c6-b4f3-25117b0ac3de tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.226681 Aug 11 16:28:40.313909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 50/87] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:40 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:40.430004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:40.431150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:40.444675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.446253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.447711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.449439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.450467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.451336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.494786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.509807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e202b007-b33b-4dcb-8eb3-772f08559ece tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.491241 Aug 11 16:28:40.510447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 38/88] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:40 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:40.520007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0278953-274a-4642-b41e-84a99a1616dd", "tag": "050207d3-2fc8-4a6e-b1ec-6d51df4593bb"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:40.531542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.532015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.532462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.544975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.546696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] Creating event network-changed:050207d3-2fc8-4a6e-b1ec-6d51df4593bb for instance e0278953-274a-4642-b41e-84a99a1616dd on hv-cinder-85220 Aug 11 16:28:40.551796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-5464efde-5699-401a-817c-f796c701825e req-387abaf1-1195-4c77-8438-ab53ce156e0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040201 Aug 11 16:28:40.552473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37f0c437-f7c2-4e72-9bad-b44e24aebf15 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.127606 Aug 11 16:28:40.552656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 39/89] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:40.553033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 51/90] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:40 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:40.638686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:40.639383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:40.646620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.647971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.648808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.649686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.650411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.650901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.773758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:40.774688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:40.788668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.789366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.789991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.791100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:40.791965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:40.792558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:40.794304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.806634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7de26a08-e973-42bf-84f1-f435656a5e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.172390 Aug 11 16:28:40.807760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 40/91] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:40 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:40.879029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.890763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.892718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:40.894246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b7e8a753-d3e2-4bae-8df8-ff5ea9e34437 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1340 microversion: 2.20 time: 0.125894 Aug 11 16:28:40.894793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 52/92] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1340 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:41.333513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:41.334124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:41.340384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.341068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.341966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.343238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.343832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.344512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.530911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:41.531536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:41.534159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:41.542234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.543140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.543728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.544754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.545361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.545934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.769472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:41.777426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48cd8744-d92c-448e-a45e-e811483000ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.250563 Aug 11 16:28:41.778532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 53/93] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:41 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:41.804553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:41.812000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:41.815901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.816524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.817056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.817869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.818416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.818994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.861744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=22 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:41.918827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:41.927340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae52a6db-3700-485c-a3d1-9ee984b264a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.145930 Aug 11 16:28:41.927919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 54/94] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:41 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:41.943608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:41.945351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:41.952209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.952993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.953513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:41.954346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:41.954871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:41.955408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.177982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.189046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c44423e8-11b7-483c-8328-fce43e07df1e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.259275 Aug 11 16:28:42.190020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 55/95] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:41 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:42.207243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:42.208173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:42.217617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.218173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.218675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.219433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.219943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.220481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.226325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:42.294697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.306516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.309225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.310706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c47c7276-dddf-4839-bca3-e47cb710fec2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1340 microversion: 2.20 time: 0.119552 Aug 11 16:28:42.325512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 56/96] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:42.355012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.366758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7586b109-ae4f-4799-a709-0dfe7f02d63c tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 1.036141 Aug 11 16:28:42.374690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 41/97] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:41 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:42.799405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:42.800006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:42.802048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=36 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:42.807650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.808140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.808570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.809252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.809695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.810105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.939439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:42.948843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-921b542d-c3e9-46c1-8af0-fd69ed8cc646 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.153222 Aug 11 16:28:42.949628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 57/98] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:42 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:42.949816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:42.950413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:42.952317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=8 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:42.957103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.957696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.958017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:42.958711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:42.959451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:42.960038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.043609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.055126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-62e1d833-eab6-4870-b07f-46b1a28a88a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1299 microversion: 2.1 time: 0.109116 Aug 11 16:28:43.055665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 42/99] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:42 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:43.212193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:43.212764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:43.219196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.219977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.220623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.221522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.222152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.222759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.337160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:43.337777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:43.352065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.352589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.353023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.353769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.354169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.354592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.381808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.393097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81d13755-4395-4cbd-bf2b-d08bfa88ef5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.185322 Aug 11 16:28:43.393680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 58/100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:43 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:43.398377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:43.399008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:43.405269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.405956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.406564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.407248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.407700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.408135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.568369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.577485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.585764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.587344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:43.588501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3bcff5e5-ac55-4319-a02b-6b56df8a49d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.256007 Aug 11 16:28:43.589533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 43/101] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:43.590915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bac4a13d-6200-448a-bdca-40f6deb2ad06 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.196208 Aug 11 16:28:43.591787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 59/102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:43 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:43.970134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:43.970735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:43.976821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.977292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.977713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:43.978386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:43.978827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:43.979237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.076015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:44.076658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:44.078496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:44.083584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.084060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.085527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.086407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.086867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.087286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.092932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=95 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:44.112179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.120969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-31d782c1-b799-4bd4-8343-82aea1311017 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.154787 Aug 11 16:28:44.121541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 60/103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:43 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:44.216709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.224047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f6ec432f-7325-4c3c-9736-af88550191d2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.151777 Aug 11 16:28:44.224574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 44/104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:44 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:44.413976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:44.414617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:44.420601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.421065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.421483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.422149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.422585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.422994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.582674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.590500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3132c148-b729-4449-81eb-9d65b7633417 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.180639 Aug 11 16:28:44.591076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 61/105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:44 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:44.616778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:44.617392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:44.618979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:44.619713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:44.623304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.623785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.624234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.625094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.625710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.626273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.626953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.627508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.628006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.628835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:44.629459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:44.630032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:44.779471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.789336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.791405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.792879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c0211433-db57-4a31-ae0a-a61f6aba06d2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.180495 Aug 11 16:28:44.794277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 45/106] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:44.809109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:44.819572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-794023d4-e138-4d82-acea-7eec6efeb880 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.206430 Aug 11 16:28:44.820177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 62/107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:44 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:45.143198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:45.144034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:45.150392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.150872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.151305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.151996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.152479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.153046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.245690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:45.246884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:45.258706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.259521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.260256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.261655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.262315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.263074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.318025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:45.326824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e3b060a9-ca29-445a-871a-a1cdd3189d04 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.187796 Aug 11 16:28:45.327586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 46/108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:45 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:45.488600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:45.496489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f3a9081-14fc-4fde-8662-bf7e9515be5b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.255631 Aug 11 16:28:45.497260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 63/109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:45 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:45.611542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:45.612621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:45.619581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.620240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.620862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.621640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.622200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.622697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.816953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:45.817563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:45.826634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.827555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.828365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:45.830548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:45.831430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:45.832402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.009857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.020520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.022739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.024052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-060e3e3b-3951-4b68-8b91-3d9a23e77dab tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.211002 Aug 11 16:28:46.024713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 64/110] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:28:46.055129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:46.056970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:46.060307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:46.065301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.065857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.066352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.067107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.068303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.068858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.237316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.246988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e497f44-9728-4820-b3b2-19c3aa4f159f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.197072 Aug 11 16:28:46.248627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 65/111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:46 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:46.300629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.308851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eccc204d-6d3b-496a-aa06-9ef2d7df1741 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.701732 Aug 11 16:28:46.309430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 47/112] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:45 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:46.348526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:46.349137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:46.355292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.355776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.356246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.356940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.357394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.357817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.519714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:46.520954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:46.528401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.529413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.530242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.531370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:46.532009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:46.532698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:46.580969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:46.595395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8c40ae6b-6453-4bcc-9377-c32dba4d6be2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.250877 Aug 11 16:28:46.596543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 66/113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:46 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:47.058098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:47.060421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:47.086182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.088155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.090170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.093066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.096512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.098271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.174226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:47.184523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dcb7a826-9f59-4748-bc8a-e9973858ffe8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.670332 Aug 11 16:28:47.189804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 48/114] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:46 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:47.269156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:47.270651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:47.286606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.288796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.289442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.293587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.295161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.295885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.605101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:47.626589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:47.630267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:47.631763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-deaaa340-b5d0-448a-b272-21af44925de6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.585766 Aug 11 16:28:47.633870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 67/115] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:47.647502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:47.649383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:47.661143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.661747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.663129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.663958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:47.664491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:47.665146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:47.914320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:47.922899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e390de2d-8a32-4b1e-8196-a06b670c079e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.287194 Aug 11 16:28:47.923486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 68/116] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:47 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:48.092089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad28131-4298-4448-bdb8-74313c3bf525", "name": "network-vif-plugged", "status": "completed", "tag": "d092b0e0-4c57-4a25-b642-5a3ba8e66bf6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:48.109652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.109652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.109652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.126435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.132971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Creating event network-vif-plugged:d092b0e0-4c57-4a25-b642-5a3ba8e66bf6 for instance aad28131-4298-4448-bdb8-74313c3bf525 on hv-cinder-85220 Aug 11 16:28:48.133513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 16:28:48.134047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6ed53b39-1833-46e5-85ba-af7a7ea8f16b req-ecce6777-1f40-4bb4-b31b-1c3fa8f9f124 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 16:28:48.135526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.136709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.137426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.138151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.138676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.139081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.140469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-67e0db3c-baac-4ba5-bba3-736d09791644 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.874321 Aug 11 16:28:48.144243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 49/117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:47 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:48.151755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.compute.rpcapi [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 16:28:48.151927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:48.152637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:48.153140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] Releasing lock "compute-rpcapi-router" {{(pid=120731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 16:28:48.171451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.172062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.173002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.173769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.174579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.175157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.183543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3412f2fa-9d78-4556-80d8-632356f00734 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242890 Aug 11 16:28:48.185006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 69/118] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:48.215796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:48.216723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:48.226311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.226852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.227460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.228409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.229068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.229834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.399364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.409416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67948323-9ea0-4f28-82d2-07fe9527872e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.202395 Aug 11 16:28:48.423802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 70/119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:48 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:48.429100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:48.435292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.439904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.440656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.441593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.450177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6ce2e9db-bb52-45f8-b14b-34d9d18b1b9a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.303964 Aug 11 16:28:48.451026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 50/120] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:48 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:48.455805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] Creating event network-changed:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:28:48.466155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-cbd69e57-5640-4642-8b2c-d312a3aef25c req-7c5a53aa-fffd-4179-b609-c9f95bb0e82d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041168 Aug 11 16:28:48.466676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 71/121] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:48.655922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:48.656603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:48.662557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.663026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.663449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.664151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.664597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.665013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.804006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.813036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.814547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:48.815654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0a9dedf0-1c34-4eba-8c09-24c9a538d9f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.163628 Aug 11 16:28:48.816241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 51/122] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:48.951636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:48.952496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:48.959082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.959668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.960221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:48.960948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:48.961399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:48.961843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.106458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:49.113723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-336c074d-d513-4911-a93e-0c5176119edd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.166216 Aug 11 16:28:49.114696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 72/123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:48 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:49.167503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:49.168144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:49.174108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.174438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.174924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.175568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.176000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.176447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.311290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:49.319738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ed9b57a1-53d5-41d9-b3da-2af5f1f70b07 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.156501 Aug 11 16:28:49.320438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 52/124] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:49 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:49.434595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:49.435202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:49.441027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.441498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.441925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.442594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.443034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.443497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.471102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:49.471978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:49.478895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.479376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.479816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.480534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.480992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.481412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.589598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:49.594211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:49.600458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-10ab9eb2-78e1-4a1e-87eb-9a76ff181c87 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.169203 Aug 11 16:28:49.601536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 73/125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:49 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:49.631676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:49.648964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7c7c60be-25eb-4fb1-8aa6-9d46f613e98f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.181646 Aug 11 16:28:49.649555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 53/126] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:49 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:49.839667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:49.840398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:49.846538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.847094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.847589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.848367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:49.848902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:49.849398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:49.996439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.007712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.010877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.012067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc06aaff-5665-4b4f-ab7f-ed9c5bee150d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.176296 Aug 11 16:28:50.012918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 74/127] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:50.135614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:50.136287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:50.142270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.142755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.143192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.143874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.144355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.144776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.271745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.279513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-56df8d42-03a7-44c3-a7c5-2eb347b0d60a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.148602 Aug 11 16:28:50.280077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 54/128] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:50 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:50.341883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:50.342475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:50.348880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.349381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.350740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.351771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.352254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.352677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.481100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bfca9f-d7bf-443a-9d7e-70b0774da2b0", "tag": "1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:50.485752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.491142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.491632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.492000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.493820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf55de59-6ca7-4ed2-8120-b5ce2fa2d119 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.157077 Aug 11 16:28:50.494390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 75/129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:50 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:50.503023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] Creating event network-changed:1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f for instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 on hv-cinder-85220 Aug 11 16:28:50.507898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-51839580-baa2-44c3-95fe-ec82d8fc203f req-cdf80d71-05e5-408b-a36f-5e56c595e2d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030537 Aug 11 16:28:50.508502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 55/130] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:28:50.622123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:50.622733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:50.628692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.629167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.629801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.630493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.630968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.631436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.678122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:50.680194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:50.688847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.690891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.691521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.692435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:50.693239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:50.693901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:50.821585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.830060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a272d13-e142-487d-9327-5c0f7aed91a7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.211724 Aug 11 16:28:50.844129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 76/131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:50 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:50.886988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:50.896173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fadcfa2e-98cf-4caf-85f0-17fc97a9e80a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.226166 Aug 11 16:28:50.897314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 56/132] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:50 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:51.036022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:51.036793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:51.052641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.053856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.054960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.060217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.061559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.062191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.139222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fca7c34-392f-431f-8ba3-191be7a54e10", "name": "network-vif-plugged", "status": "completed", "tag": "6a27283a-4da4-4638-bff4-70f79f256e03"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:51.151670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.152250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.152691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.196549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] Creating event network-vif-plugged:6a27283a-4da4-4638-bff4-70f79f256e03 for instance 7fca7c34-392f-431f-8ba3-191be7a54e10 on hv-cinder-85220 Aug 11 16:28:51.209316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-9e0b8f3a-3e76-4bee-9f4e-7ba661c6fab4 req-cbdd4fc2-773c-48df-a230-a6d9ecea7500 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074117 Aug 11 16:28:51.218678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 57/133] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:28:51.301469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:51.302165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:51.321979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.322475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.322986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.323697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.324165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.324588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.327998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:51.342120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:51.343663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:51.348142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c67ce0e6-5b95-45b0-af63-360c5a936f43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.317301 Aug 11 16:28:51.352455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 77/134] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:51.514244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:51.515241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:51.527698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.528127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.530254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.530979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.534097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.534316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.799972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:51.811092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-343ff718-fbf0-4313-87fc-559ea4e57c0d tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.301138 Aug 11 16:28:51.824130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 78/135] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:51 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:51.869214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:51.870936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:51.891709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.897836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.902000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.904919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:51.910515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:51.914280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:51.958254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:51.970480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d178fa27-3dba-4ef8-84ec-761d14f5274d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.674602 Aug 11 16:28:51.972449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 58/136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:51 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:51.984153 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:51.987186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:52.001381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.001645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.002075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.008164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.008649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.009078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.174978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.191686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b932467-d91e-4058-910d-f8ff30ecbc5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.334460 Aug 11 16:28:52.193000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 79/137] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:51 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:52.375011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:52.375625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:52.381673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.382438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.382868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.383549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.383995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.384445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.518148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.527330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.528872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.529982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d785218-9b44-49ad-a68f-c4211f4a41b9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.158822 Aug 11 16:28:52.530543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 80/138] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:28:52.536842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.545184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-96a66792-2804-47c1-b980-e1b895e529b5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.569454 Aug 11 16:28:52.545902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 59/139] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:51 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:52.833134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:52.833848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:52.840434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.840918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.841349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.842036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:52.842486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:52.842908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:52.982328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:52.990928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d488fa32-292b-4dac-92e3-8cfb4cc13f57 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.161510 Aug 11 16:28:52.991841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 81/140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:52 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:52.996626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:52.997292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:53.003488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.003971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.004434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.005125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.005600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.006029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.143891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.152039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-de796eb6-b043-4cef-9273-15b2fd69a76a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.159587 Aug 11 16:28:53.164753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 60/141] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:52 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:53.215658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:53.216444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:53.222516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.223044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.223699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.224512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.225964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.226452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.322744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0278953-274a-4642-b41e-84a99a1616dd", "name": "network-vif-plugged", "status": "completed", "tag": "050207d3-2fc8-4a6e-b1ec-6d51df4593bb"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:53.338555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.339561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.340231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.358454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] Creating event network-vif-plugged:050207d3-2fc8-4a6e-b1ec-6d51df4593bb for instance e0278953-274a-4642-b41e-84a99a1616dd on hv-cinder-85220 Aug 11 16:28:53.371467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-b2211dd6-531d-49e8-b436-51d0bdc85e01 req-63e68a2f-aa71-4053-9628-5284624571f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053655 Aug 11 16:28:53.372348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 61/142] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:53.388254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.399576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3143d25-9dae-44f5-bd45-08d47225c4be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.188406 Aug 11 16:28:53.400379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 82/143] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:53 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:53.554233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:53.554919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:53.565343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:53.565956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:53.571096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.571570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.572289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.573043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.573365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.573802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.574052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.574324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.574459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.575024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:53.575495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:53.575893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:53.724545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.727070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:53.735043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.735227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.736827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:53.738074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-22faa13a-ece0-404c-830a-cbb0e0f9a27b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.188376 Aug 11 16:28:53.738640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 62/144] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:28:53.745918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aed58409-88e9-45f9-8a21-91415e557848 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.184293 Aug 11 16:28:53.759156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 83/145] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:53 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:54.011328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:54.011938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:54.017914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.018508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.018942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.019647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.020090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.020531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.174475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:54.175204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:54.181866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.182346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.182793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.183462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.183909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.184361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.204136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.212923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-480e7f9e-4844-4f65-9a66-e7d0addbb722 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.205598 Aug 11 16:28:54.220775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 63/146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:54 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:54.371340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.378979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ce872df-e539-4ef5-9ad2-7c710b410a6f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.208233 Aug 11 16:28:54.379544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 84/147] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:54 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:54.423565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:54.424331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:54.430875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.431807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.432343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.433041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.433646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.434327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.580024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.588426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-396958b6-2613-4b6f-b169-5ffec76e388a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.169224 Aug 11 16:28:54.588989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 64/148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:54 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:54.761765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:54.762538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:54.766994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:54.767898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:54.769111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.769950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.770742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.771542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.772390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.773076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.775229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.775719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.776371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.777094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:54.777666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:54.778253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:54.915151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.923469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-24e607f4-f7e7-4505-9aab-ddbc0b6a29b6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.160727 Aug 11 16:28:54.930328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 65/149] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:54 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:54.951893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.960176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.961696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:54.962812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4492b4b-dc2b-4084-b707-92ef8b59187e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.205090 Aug 11 16:28:54.963374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 85/150] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:55.232486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:55.233243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:55.239323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.239796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.240255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.241594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.242046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.242663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.377579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:55.385995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9bacd474-45de-42ed-8be6-f01b040b656f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.157355 Aug 11 16:28:55.386610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 66/151] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:55 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:55.408039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:55.408928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:55.415952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.416550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.417075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.417890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.418408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.418877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.555434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:55.564252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86683f16-db72-496b-a50a-704149d042ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.160575 Aug 11 16:28:55.565187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 86/152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:55 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:55.609407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:55.612247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:55.617576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.618157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.618680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.619617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.620152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.620655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.776025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:55.788768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dbb80956-8f1b-4613-aee6-29d664e9fe08 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.183043 Aug 11 16:28:55.802387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 67/153] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:55 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:55.950108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:55.951053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:55.960570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.961453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.961887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.963360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.963830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.964847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.987587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:55.988233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:55.995014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.995761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.996371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:55.997204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:55.997807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:55.998682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.121874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.132422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0517344a-515c-4ce2-adba-ae867af176e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1363 microversion: 2.1 time: 0.190808 Aug 11 16:28:56.133344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 87/154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:55 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:56.150118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.158199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.159830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.161026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e43442d9-2092-48c3-9a24-80fd3004fc59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.178193 Aug 11 16:28:56.161629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 68/155] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:56.406606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:56.407331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:56.414828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.416407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.417223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.418121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.418717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.419413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.586396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.590077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:56.590926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:56.606269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b536f59-b25b-4deb-bbb5-5063f070d0ca tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.198221 Aug 11 16:28:56.607052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 88/156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:56 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:56.607582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.608490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.609158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.610228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.612038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.612631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.810406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:56.811024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:56.819423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.820432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.820925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.821630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:56.822311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:56.822729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:56.845283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.854569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-05bd9ef3-3439-4ec6-8750-4819a8e9dc34 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.272687 Aug 11 16:28:56.855478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 69/157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:56 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:56.967037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:56.979280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a4f34d7-ae5b-4f0a-b43c-6fc64c91936d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.169414 Aug 11 16:28:56.979280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 89/158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:56 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:28:57.153071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.153729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:57.159707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.160222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.160657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.161340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.161788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.162206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.185771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.186459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:57.192594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.193304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.194456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.195427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.195947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.196456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.217603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:57.310285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:57.319660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02970a99-db77-458d-b989-48386c69ca83 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1548 microversion: 2.1 time: 0.170030 Aug 11 16:28:57.320292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 70/159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:57.340944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.341440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:57.341826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:57.347434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.347922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.348383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.349343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.350663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.351456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.352149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:57.353649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:57.354942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-708d1da9-455f-4d63-a2b3-25f5d4ff1539 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.174489 Aug 11 16:28:57.355507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 90/160] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:57.574888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cff93e-cea6-4a7e-92ce-c2f0990edc7e", "name": "network-vif-plugged", "status": "completed", "tag": "815de520-05d9-494f-9457-2930d19312ed"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:57.588718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.589457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.589648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e4de0aa9-8405-4e27-9063-5c992a8dc69b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252297 Aug 11 16:28:57.590446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 71/161] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:28:57.590864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.610250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] Creating event network-vif-plugged:815de520-05d9-494f-9457-2930d19312ed for instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e on hv-cinder-85220 Aug 11 16:28:57.619227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-ce644c24-d656-4a3f-93f7-229879e54c47 req-c7ad5849-8f1a-486c-8b0a-9e4753eda204 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050096 Aug 11 16:28:57.620431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 91/162] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:57.627549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.628732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:57.639593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.640890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.641613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.642356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.643084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.643735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.807446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:57.824309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41504e73-fa7b-4639-a2db-bc5bc69c04c1 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.200888 Aug 11 16:28:57.825776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 72/163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:57.884437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.884437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:57.887624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.888448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.889668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.890384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:57.890995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:57.891420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:57.997977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:57.998719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:58.006422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.007328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.007962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:58.008877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.009498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.010308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:58.148645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:28:58.461521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:58.489233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8aa5f1be-2d7c-4aa5-a469-e65567b74709 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.494868 Aug 11 16:28:58.490351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 73/164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:58.495868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:58.509621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:58.537205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.538019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.538464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:58.539178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.539631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.540245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:58.587405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:58.597479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e16d53c3-8617-437c-afa8-8d8569178bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.723237 Aug 11 16:28:58.598152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 92/165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:57 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:58.729461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:58.737244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:58.738824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:58.739919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0cc84ae1-d050-4010-9a5d-ee0c6fc3055a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.247864 Aug 11 16:28:58.741538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 74/166] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:28:58.847847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:58.848486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:58.855527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.856164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.856639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:58.857511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:58.858112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:58.858682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.114110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:59.122312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b8a898bd-a57f-4ac4-9f5f-751f89842fd4 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1315 microversion: 2.1 time: 0.279166 Aug 11 16:28:59.122922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 93/167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:58 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:59.332670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fca7c34-392f-431f-8ba3-191be7a54e10", "tag": "6a27283a-4da4-4638-bff4-70f79f256e03"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:28:59.342642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.343233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.343749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.358525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] Creating event network-changed:6a27283a-4da4-4638-bff4-70f79f256e03 for instance 7fca7c34-392f-431f-8ba3-191be7a54e10 on hv-cinder-85220 Aug 11 16:28:59.363826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-03c1ae5d-5853-4cf8-bf3f-2c67432108c4 req-12024c88-af4e-4119-8b65-ce07b82b471a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034824 Aug 11 16:28:59.364724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 75/168] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:28:59.511811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:59.512426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:59.518453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.518943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.519364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.520266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.520716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.521318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.619992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:59.621165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:59.634084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.634571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.635440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.635682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.636149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.637495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.727773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:59.738964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2fde966f-9a2e-46e0-b0fc-486f7fdcdecf tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.231302 Aug 11 16:28:59.741407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 94/169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:59 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:28:59.763745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:28:59.764835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:28:59.773015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.773867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.774404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.775383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:28:59.775989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:28:59.776552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:28:59.921201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:28:59.937893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f98902ac-4084-4448-b29e-32429ab589fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.322600 Aug 11 16:28:59.938494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 76/170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:28:59 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:00.000705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:00.009038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:00.010593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:00.012365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5dbb065-d1c5-4918-8ae5-fef9881e0acf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.253289 Aug 11 16:29:00.013280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 95/171] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:28:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:29:00.144627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:00.145366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:00.152891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.153610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.154202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:00.155043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.155649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.156275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:00.313985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:00.323494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7584365e-547e-43d6-9e1f-06ef70adb457 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1502 microversion: 2.1 time: 0.183628 Aug 11 16:29:00.324083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 77/172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:00 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:00.762610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:00.763346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:00.769655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.770350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.771050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:00.771840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.773525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.774104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:00.922913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:00.931903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67ae9508-cec9-4875-864a-b1f8c9b340b9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.173321 Aug 11 16:29:00.932858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 96/173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:00 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:00.958022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:00.959355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:00.965863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.966257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.966926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:00.976213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:00.976705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:00.977308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.039462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:01.041146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:01.060862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.063436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.065684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.067670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.069635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.072305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.221279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:01.232315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-27d0506f-d223-49d8-a1a8-da9972d8dfb3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.277984 Aug 11 16:29:01.236066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 78/174] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:00 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:01.311837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:01.320240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:01.322604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:01.323924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89cef752-bd17-4ef0-856c-b1d0cc4f74fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.290069 Aug 11 16:29:01.337714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 97/175] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:01.796220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8edff2d5-da86-4950-b4ef-c42884cacfb9"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:01.798623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:01.804831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.805303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.805727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.806672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.807280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.807695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.954198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:01.954928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:01.962796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.963309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.964189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:01.965052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:01.965551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:01.966440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:02.126063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:02.134260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff566c2e-4b51-4bdc-9fc6-e1b3f396f0b1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.184317 Aug 11 16:29:02.134833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 98/176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:01 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:02.253488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:02.254224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:02.261132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:02.262385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:02.262939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:02.263903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:02.264416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:02.264990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:02.439588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:02.511378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:02.533412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9265dd24-3ee9-4f65-ae63-dfc2ce835a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1322 microversion: 2.1 time: 0.283981 Aug 11 16:29:02.534395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 99/177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:02 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:02.556636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:02.557488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:02.565007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:02.566144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:02.566819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:02.567765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:02.568465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:02.569068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:02.707625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff4167b9-8d1b-4875-85e3-38cd195c8b26 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "POST /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914747 Aug 11 16:29:02.710074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 79/178] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:29:01 2022] POST /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:02.781594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:02.790110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:02.791608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:02.792743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b83959eb-db5e-489b-abde-f4d3444ae1fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.246506 Aug 11 16:29:02.794926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 100/179] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:03.164195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:03.165123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:03.172293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.173090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.173815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.174788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.175431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.176003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.351676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:03.359293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c60f59d2-3613-4e67-9dad-69cd0a385639 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.200150 Aug 11 16:29:03.359862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 80/180] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:03 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:03.561068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:03.562452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:03.569444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.569885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.570358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.571208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.571843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.572306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.743958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:03.753404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a08832f8-baff-4767-80b0-3e6394a98895 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1516 microversion: 2.1 time: 0.196321 Aug 11 16:29:03.754044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 101/181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:03 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:03.776488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:03.778811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:03.785615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.786099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.786533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.787800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.788539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.789046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.822722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:03.823898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:03.842330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.843019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.844146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.847060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:03.848364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:03.849692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:03.885192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'flavor' on Instance uuid d9cff93e-cea6-4a7e-92ce-c2f0990edc7e {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:29:04.085464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d37f7ad5-25ff-420d-8358-74a1b02ed1dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e/action" status: 200 len: 32 microversion: 2.1 time: 0.313320 Aug 11 16:29:04.091401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 81/182] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:29:03 2022] POST /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 16:29:04.092148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:04.098402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:04.099393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:04.102146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:04.103693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:04.104897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ecf5b03-e027-4944-a618-177d05f0cbcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.287735 Aug 11 16:29:04.105975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 102/183] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:04.110272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:04.111460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:04.112372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:04.113615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:04.114313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:04.115947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:04.379920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:04.380912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:04.387853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:04.388363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:04.388790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:04.389505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:04.390112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:04.390687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:04.402872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:04.418179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5cfd9a6e-8c1c-4a6e-b705-97c2b22b3ff4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.324641 Aug 11 16:29:04.418898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 82/184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:04 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:04.546303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:04.556786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c2d0979f-5b82-448a-88e0-6806e1715c51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.180368 Aug 11 16:29:04.557374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 103/185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:04 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:05.131608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:05.133401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:05.139420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.139906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.140388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.141088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.141697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.142151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.277879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:05.286663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:05.289030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:05.290155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-51af281b-ca48-47d9-8176-c22599524f9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.164959 Aug 11 16:29:05.290834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 83/186] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:05.439925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:05.440573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:05.449003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.449474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.449899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.450579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.451020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.451443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.578683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:05.579302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:05.591807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.592390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.592840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.593617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:05.594062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:05.594486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:05.609458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:05.617606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afdc3f25-5e2e-496a-97b5-38c88d825bfe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.181462 Aug 11 16:29:05.618409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 104/187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:05 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:05.806427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:05.815660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-020ee8c0-c5d0-4bb0-85f4-5a9d89288f3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.240835 Aug 11 16:29:05.816822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 84/188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:05 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:06.313174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:06.314059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:06.322058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.322695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.323544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.324277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.324822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.325994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.480487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:06.502093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:06.503690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:06.504893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e164531-1502-4308-91de-5a7046eb12c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.195896 Aug 11 16:29:06.510992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 105/189] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:06.613760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bfca9f-d7bf-443a-9d7e-70b0774da2b0", "name": "network-vif-plugged", "status": "completed", "tag": "1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:06.638876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:06.639563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:06.640906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.642070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.642909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.648705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.650943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.651389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.652081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.652783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.653103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.661820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] Creating event network-vif-plugged:1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f for instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 on hv-cinder-85220 Aug 11 16:29:06.678945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-f5a10de5-d845-46b3-94ec-59ff65a3af14 req-19999a62-1631-4d29-921d-233b6e2ca034 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071441 Aug 11 16:29:06.680986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 85/190] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:06.838622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:06.839056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:06.869259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:06.879877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.882498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.885051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15c77146-dc8a-4e75-9253-10db4ae0e811 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.249842 Aug 11 16:29:06.885623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:06.886410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:06.887802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 106/191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:06 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:06.890063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:06.892661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:07.193550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:07.198085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-276a0a0f-6955-4d11-ab92-7d89cd212cd5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.364903 Aug 11 16:29:07.200616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 86/192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:06 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:07.530097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:07.530713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:07.557108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:07.557811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:07.558411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:07.559272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:07.559885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:07.560363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:07.712492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:07.715973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:07.722033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:07.723562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:07.724927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7bf7eed-4173-45cd-9918-4e69e0ea5f1c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.198841 Aug 11 16:29:07.725947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 107/193] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:29:07.906641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:07.907248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:07.914408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:07.914983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:07.915488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:07.916211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:07.916668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:07.917096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.064460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:08.074230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bc5f6caf-cd1a-433b-9dcf-0d5d95af8730 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.170074 Aug 11 16:29:08.074815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 87/194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:07 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:08.223061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:08.223682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:08.238038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:08.238680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:08.239115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.239809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:08.240668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:08.241149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.406901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:08.415335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-58e153ea-85d4-4efa-abad-01086cd35cf9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1367 microversion: 2.1 time: 0.198108 Aug 11 16:29:08.424203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 108/195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:08 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:08.716026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "name": "network-vif-plugged", "status": "completed", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:08.746228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:08.746709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:08.747145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.749428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:08.750185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:08.757417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:08.757898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:08.758329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.759492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:08.759933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:08.760548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:08.762358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] Creating event network-vif-plugged:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:29:08.767542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-cf15e320-e9ed-4c4d-a978-a1e51c8b191d req-9b834564-a9de-4975-9b7d-de7ab8623a55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055078 Aug 11 16:29:08.768318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 88/196] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:08.821834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1745852596", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "networks": [{"uuid": "3611c47a-6371-460a-acc1-5e4d2297a682"}]}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:08.881720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] validate_networks() for [('3611c47a-6371-460a-acc1-5e4d2297a682', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:29:08.920598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:08.932174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:08.933724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:08.934859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2284c653-bd99-4c0e-92c9-e8dee2e092b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.190705 Aug 11 16:29:08.935403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 109/197] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:29:09.094863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:09.095469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:09.101910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.102664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.103099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.103795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.104278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.104703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.288397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:29:09.288822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:29:09.289042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:09.289287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:29:09.289696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:29:09.290111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:29:09.299910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.300427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.300866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.301686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.302143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.302623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.305256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-13612ed3-cae9-413b-bd29-7fd6bcb47f7e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.214021 Aug 11 16:29:09.306698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 110/198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:09 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:09.324071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Getting quotas for project 26ff1514f2c240f0808f8aad188ac97f. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:29:09.328490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Getting quotas for user 7d3bafbdaf274f33aef3c7d066eda6c8 and project 26ff1514f2c240f0808f8aad188ac97f. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:29:09.339746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:09.343015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:29:09.345805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:29:09.402582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-54a6fe6b-9aac-4a25-ba29-32e9d0ff4228 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596379 Aug 11 16:29:09.404198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 89/199] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 16:29:09.414497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79baa3bc-601f-45e7-8946-4ac2747ebd39 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:09.415282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79baa3bc-601f-45e7-8946-4ac2747ebd39 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:09.439428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:09.440277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:09.450792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.451293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.451832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.452568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.453018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.453439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.473718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79baa3bc-601f-45e7-8946-4ac2747ebd39 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:09.481556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79baa3bc-601f-45e7-8946-4ac2747ebd39 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1214 microversion: 2.1 time: 0.071151 Aug 11 16:29:09.493224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 111/200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:09 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:09.673259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:09.684355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-49c4b842-2cee-4f25-b3e4-b289b3060d5a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1557 microversion: 2.1 time: 0.249120 Aug 11 16:29:09.685167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 90/201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:09 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:09.716047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:09.716874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:09.724870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.725825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.726358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.733268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.734157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.734766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.883041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b51159d8-5587-47a0-9c3d-d2fa31d6ed51 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172921 Aug 11 16:29:09.884859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 112/202] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:29:09 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:09.957119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:09.957724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:09.964896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.965370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.965798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:09.966481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:09.966930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:09.967348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:10.099413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:10.107460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:10.109032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:10.110127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-620bbf5a-5172-4b75-a634-ba513079256f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.156944 Aug 11 16:29:10.110901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 91/203] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:10.328258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:10.328901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:10.336539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:10.337028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:10.337463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:10.338214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:10.338645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:10.339064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:10.502231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:10.502879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:10.509654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:10.510135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:10.510566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:10.511255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:10.511702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:10.512141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:10.573281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:10.580691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-041dcdf2-5f44-4fa8-a546-c26dfc9cbc69 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1218 microversion: 2.1 time: 0.082414 Aug 11 16:29:10.581270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 92/204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:10 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:10.602829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:10.610375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c60ed5a4-7c62-46bc-9fb4-0da8376818a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.286110 Aug 11 16:29:10.610943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 113/205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:10 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:11.135189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:11.135792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:11.158021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.158517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.158953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.159658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.160417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.160726 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.180809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bfca9f-d7bf-443a-9d7e-70b0774da2b0", "tag": "1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:11.188418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:11.204834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.205580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.206184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.219279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] Creating event network-changed:1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f for instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 on hv-cinder-85220 Aug 11 16:29:11.225641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-02ba3b66-ffa3-421a-83ad-640fb3837cb8 req-05cf48b8-f764-4f16-948e-aea4846a2397 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049528 Aug 11 16:29:11.229613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 114/206] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:29:11.382914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:11.391757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:11.393638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:11.394798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f67f058b-f13b-4a0a-bd00-0f1e41e50dfb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.264714 Aug 11 16:29:11.395359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 93/207] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:11.607887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:11.608917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:11.620182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.620845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.622429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.623368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.623862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.624338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.630775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:11.631579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:11.640787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.646171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.646705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.647729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:11.648332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:11.648925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:11.734394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:11.747188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-63aef241-e3f1-4db4-9eff-2fce00d8a86c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1266 microversion: 2.1 time: 0.147387 Aug 11 16:29:11.747871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 115/208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:11 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:11.887381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:11.894865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a521f4c9-d70d-4b1e-8e0c-784ad5628466 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.268071 Aug 11 16:29:11.895437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 94/209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:11 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:12.425814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:12.425814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:12.425814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.425814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.426470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.426470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.426470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.426724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.723349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:12.735191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:12.736995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:12.738494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b1d969c-cab6-48e7-b7fb-96d932bcc4b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.325511 Aug 11 16:29:12.740804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 116/210] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:12.774571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:12.775788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:12.780489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:12.780915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:12.799859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.800588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.801168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.805749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.807002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.808164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.810412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.811715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:12.811853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.812232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:12.812635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.812747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:12.869511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:29:13.008519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abb88edb-0d6f-4968-ab62-a658e76827b6 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 204 len: 0 microversion: 2.1 time: 0.233267 Aug 11 16:29:13.009495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 117/211] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:29:12 2022] DELETE /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 16:29:13.012387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.017908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:13.018496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:13.023818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:13.024887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.025538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.025869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.026860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5a4e864b-98be-4bb7-911c-77897d616740 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1272 microversion: 2.1 time: 0.261502 Aug 11 16:29:13.027017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.027936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.027936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.039682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 95/212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:12 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:13.052456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:13.054009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:13.062335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.063223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.066816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.068334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.069250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.069896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.190000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.197987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-56683b94-6b19-4eb5-ac41-6968a7ff1bda tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.184561 Aug 11 16:29:13.198780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 118/213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:13 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:13.218694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.227559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f8d5cf6f-9461-41cf-aed7-53e9ee89173f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1554 microversion: 2.1 time: 0.182998 Aug 11 16:29:13.228351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 96/214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:13 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:13.762430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:13.763035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:13.769918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.770395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.770827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.772200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:13.772646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:13.773406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:13.950251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.958410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.960605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:13.961718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d43a5532-cae9-431b-a28e-f96747c6305a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.203242 Aug 11 16:29:13.962276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 119/215] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:14.050713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:14.053328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:14.059025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.059638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.060151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.060979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.061517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.062132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.218956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:14.219654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:14.220446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:14.227103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.229067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fc8dfd6e-0bd2-4fd1-b246-59e661e65027 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.182082 Aug 11 16:29:14.229648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 97/216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:14 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:14.232230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.239572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.240846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.241082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.241511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.256510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:14.256510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:14.264658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.265232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.266175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.267407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.268555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.268923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.408385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:14.417635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3086cebc-8a3a-4c85-8d30-15abdecbb8fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.202500 Aug 11 16:29:14.418597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 120/217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:14 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:14.431448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:14.445959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e0577414-2415-4fc4-9a6a-2fb75aa8e4a3 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1554 microversion: 2.1 time: 0.198980 Aug 11 16:29:14.447647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 98/218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:14 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:14.984904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:14.985623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:14.992021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.992684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.993122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:14.993796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:14.994381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:14.994798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.135297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.143139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.144642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.145727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-01ff5e85-e49b-4e76-8077-c289936717ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1408 microversion: 2.20 time: 0.164860 Aug 11 16:29:15.146873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 121/219] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:15.253547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:15.254151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:15.261206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.261679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.262107 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.262782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.263221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.263631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.409463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.417327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-52a24f00-ea67-4f8f-b67c-5ffcb870b975 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.167510 Aug 11 16:29:15.418043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 99/220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:15 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:15.438669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:15.439278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:15.445927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.446404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.446838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.447527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.448010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.448433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.471773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:15.472564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:15.478768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.479296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.479727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.480500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:15.480951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:15.481369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:15.603219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.611023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bfe83661-12b2-4bf9-87ba-717f6f951610 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.176174 Aug 11 16:29:15.611962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 122/221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:15 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:15.647741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:15.657575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-00b7a039-f729-4638-819b-0a8b0f647032 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1554 microversion: 2.1 time: 0.189441 Aug 11 16:29:15.658263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 100/222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:15 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:16.169122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:16.170321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:16.176390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.176869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.178206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.179056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.179675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.180127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.335642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:16.356031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:16.357763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:16.359633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91e39579-5e63-4b64-a622-3c39eda259f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1599 microversion: 2.20 time: 0.194450 Aug 11 16:29:16.361219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 123/223] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:29:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1599 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:29:16.383627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:16.384124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:16.390287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.390771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.391258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.392158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.392610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.393031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.440956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:16.441597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:16.447730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.448253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.448689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.449381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.449832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.450254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.507581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b642548f-b20f-4396-8eb3-df9528dfda56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128199 Aug 11 16:29:16.508483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 101/224] 10.222.0.43 () {60 vars in 1316 bytes} [Thu Aug 11 16:29:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:29:16.535488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca027421-b638-459a-b9f4-37749d801a0d", "tag": "305a448d-6eda-4258-83e0-a98454191a64"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:16.551012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.551489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.552087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.582334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] Creating event network-changed:305a448d-6eda-4258-83e0-a98454191a64 for instance ca027421-b638-459a-b9f4-37749d801a0d on hv-cinder-85220 Aug 11 16:29:16.595471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-86d61de1-6db5-4cec-999b-2f93898c95ec req-10df83d0-1dbd-458c-a28f-793ec9fdc162 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065053 Aug 11 16:29:16.596138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 102/225] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:29:16.646185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:16.647689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:16.656392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.657087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.657523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.658207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.658649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.659090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.723513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:16.733447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:16.755379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-323bedf4-ca5c-4a1e-a0a2-3be9f5749356 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.318061 Aug 11 16:29:16.756534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 124/226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:16 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:16.776676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:16.777519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:16.788213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.789660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.790310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:16.792240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:16.792910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:16.793563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:17.096533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:17.103612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:17.106141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-804ce15b-6ae9-437f-b357-9622d4d68011 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.476551 Aug 11 16:29:17.107876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 103/227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:16 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:17.116419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-effb11a7-461e-43d7-b5e3-f379aeecbc92 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1554 microversion: 2.1 time: 0.344860 Aug 11 16:29:17.118044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 125/228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:16 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1554 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:17.689892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:17.716412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:17.716913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:17.717342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:17.737136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] Creating event network-changed:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:29:17.743086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-7e8e881e-bfa6-4911-a525-e6361377ee3b req-f00eb30c-8bee-426b-ba4a-f5e048debd09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056648 Aug 11 16:29:17.743780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 104/229] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:17.782972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:17.784926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:17.792947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:17.793797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:17.794470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:17.795394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:17.796117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:17.796773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:17.941824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:17.952044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa6d5069-cf3b-4a02-a1b6-f01ae8f16111 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.172782 Aug 11 16:29:17.952854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 126/230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:17 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:18.139161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:18.139826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:18.143469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:18.148780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:18.150007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.150515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.150932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.156603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.157091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.157524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.162624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.163337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.163780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.164519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.164980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.165397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.276592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:18.289980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90fef9eb-caed-4953-ad95-febbfe0500ad tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1512 microversion: 2.1 time: 0.150440 Aug 11 16:29:18.291265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 127/231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:18 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:18.534220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:18.544134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-483e8dd8-d0b7-4b6e-9daf-2c7811c98fe4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.408718 Aug 11 16:29:18.545028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 105/232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:18 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:18.634834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0278953-274a-4642-b41e-84a99a1616dd", "name": "network-vif-deleted", "tag": "050207d3-2fc8-4a6e-b1ec-6d51df4593bb"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:18.652089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.652594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.653229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.667585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] Creating event network-vif-deleted:050207d3-2fc8-4a6e-b1ec-6d51df4593bb for instance e0278953-274a-4642-b41e-84a99a1616dd on hv-cinder-85220 Aug 11 16:29:18.675698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-ac5eb472-c634-4eb0-ad66-741da3e90db5 req-5dd9c4e9-c3f3-4606-af72-31624727492d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044311 Aug 11 16:29:18.676409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 128/233] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:29:18.973798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:18.975087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:18.981566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.982044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.982474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:18.983153 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:18.983599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:18.984016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.123920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:19.131436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ae4ed524-7f81-468c-b56b-3c2735c47af8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.161535 Aug 11 16:29:19.132002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 106/234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:18 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:19.319921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:19.321174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:19.328738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:19.329237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:19.329737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.330577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:19.330802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:19.331161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.363417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:19.363895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:19.364357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.364847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lazy-loading 'fault' on Instance uuid e0278953-274a-4642-b41e-84a99a1616dd {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:29:19.409439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:19.417353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f1585ed-a9db-48dc-8e1f-0ef41f5bfb69 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1351 microversion: 2.1 time: 0.103991 Aug 11 16:29:19.417916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 129/235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:19 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:19.569206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:19.569954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:19.572283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:19.572983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:19.580141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:19.580631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:19.581694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.582747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:19.583205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:19.584274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:19.712525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:19.720791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2874e2fa-2094-47bd-8d05-2e730d0ccb11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.156885 Aug 11 16:29:19.724140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 107/236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:19 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:20.152060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:20.152624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:20.154566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:20.160077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.160600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.161024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.162354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.162801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.163211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.292825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:20.302245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8496704-c364-40c9-8bca-20a6e05d409d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.153864 Aug 11 16:29:20.302945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 130/237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:20 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:20.437755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:20.438364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:20.445756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.446613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.447243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.448204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.448864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.449496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.482316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.482885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.483552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.484174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lazy-loading 'fault' on Instance uuid e0278953-274a-4642-b41e-84a99a1616dd {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:29:20.531513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca40eca0b6140a498e034e3e37a8c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b79bd8e6b84cd3a082d80b4aa3a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:20.539906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c2427b02-b781-4c84-ab05-4e94bcd3c162 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 200 len: 1351 microversion: 2.1 time: 0.105902 Aug 11 16:29:20.540487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 108/238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:20 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:20.742375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:20.742990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:20.748934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.749415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.749850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:20.750546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:20.751000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:20.751421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.151546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:21.159504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f73d7034-1cb7-48b1-be37-28f5d3fa19ae tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.421119 Aug 11 16:29:21.160073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 131/239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:20 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:21.324535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:21.325356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:21.331931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.332450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.332880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.333825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.334243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.334662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.469735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:21.478179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ada2e2a4-c375-4562-ada6-794000a4a675 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.158079 Aug 11 16:29:21.478813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 109/240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:21 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:21.560980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:21.561596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:21.568511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.569021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.569460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.570177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.570639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.571064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.586257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] HTTP exception thrown: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Request method failure captured: Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd HTTP/1.1 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4iIBg1jzDy9ehTxe809PKcifA7EuK3Xxd9UbBD5Lipm5BDVK-zOJPLmULRjWTnKJ6uGvaXaPflOWEjDDRUg9bWK1JLlJ_4vgqlgB1M3WFG_ocjcdZDpvJqmsB-ioV7juWcz-b7OdoIyVuGgw_fKV33be33SYwSNaAIZeLJANjehB0 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:29:21.593953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b79bd8e6b84cd3a082d80b4aa3a546", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}] Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: eca40eca0b6140a498e034e3e37a8c47 Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.595460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'e0278953-274a-4642-b41e-84a99a1616dd'} Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:21.596297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.597605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.598877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Returning 404 to user: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:21.598877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-018c983f-bd25-45b5-b149-6787010fb5d2 tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 404 len: 111 microversion: 2.1 time: 0.038409 Aug 11 16:29:21.598877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 132/241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:21 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:21.710231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:21.712557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:21.718463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.718943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.719374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.720126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.720534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.720952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.736238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] HTTP exception thrown: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Request method failure captured: Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd/os-volume_attachments HTTP/1.1 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4iIBg1jzDy9ehTxe809PKcifA7EuK3Xxd9UbBD5Lipm5BDVK-zOJPLmULRjWTnKJ6uGvaXaPflOWEjDDRUg9bWK1JLlJ_4vgqlgB1M3WFG_ocjcdZDpvJqmsB-ioV7juWcz-b7OdoIyVuGgw_fKV33be33SYwSNaAIZeLJANjehB0 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:29:21.740650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b79bd8e6b84cd3a082d80b4aa3a546", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}] Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: eca40eca0b6140a498e034e3e37a8c47 Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.742067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': 'e0278953-274a-4642-b41e-84a99a1616dd'} Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:21.742852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:21.743934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:21.745073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Returning 404 to user: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:21.745073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6a4a428c-84e6-4dfa-af69-9846a6b5488f tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036542 Aug 11 16:29:21.745073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 110/242] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:29:21 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:21.835701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca027421-b638-459a-b9f4-37749d801a0d", "name": "network-vif-plugged", "status": "completed", "tag": "305a448d-6eda-4258-83e0-a98454191a64"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:21.846841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:21.847547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:21.848151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:21.860695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] Creating event network-vif-plugged:305a448d-6eda-4258-83e0-a98454191a64 for instance ca027421-b638-459a-b9f4-37749d801a0d on hv-cinder-85220 Aug 11 16:29:21.866017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-25c12491-80e3-40ef-8ccf-c021a58a7a50 req-85a2dbdd-3b8c-45c8-b915-69679eda2340 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034481 Aug 11 16:29:21.866917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 133/243] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:22.180963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:22.181841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:22.187894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.188398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.188822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.189493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.189934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.190347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.319261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:22.326912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c9016dda-24ae-4337-ba2f-74268868021f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.150549 Aug 11 16:29:22.327464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 111/244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:22 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:22.500927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:22.501649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:22.507785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.508305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.508744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.509433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.509886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.510306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.646949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:22.654742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b29a0709-afc6-4c79-8916-371078dcbddb tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1314 microversion: 2.1 time: 0.158059 Aug 11 16:29:22.655303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 134/245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:22 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:22.959883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:22.960423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:22.966894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.967375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.967993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.968714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:22.969167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:22.969588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:22.984722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] HTTP exception thrown: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Request method failure captured: Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd HTTP/1.1 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4iIBg1jzDy9ehTxe809PKcifA7EuK3Xxd9UbBD5Lipm5BDVK-zOJPLmULRjWTnKJ6uGvaXaPflOWEjDDRUg9bWK1JLlJ_4vgqlgB1M3WFG_ocjcdZDpvJqmsB-ioV7juWcz-b7OdoIyVuGgw_fKV33be33SYwSNaAIZeLJANjehB0 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:29:22.986913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b79bd8e6b84cd3a082d80b4aa3a546", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}] Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: eca40eca0b6140a498e034e3e37a8c47 Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:22.988313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'e0278953-274a-4642-b41e-84a99a1616dd'} Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:22.991999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:22.993361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:22.994771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Returning 404 to user: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:22.994771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-75f68f5a-6c76-4462-9529-425ca8786b9e tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 404 len: 111 microversion: 2.1 time: 0.032960 Aug 11 16:29:22.994771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 112/246] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:29:22 2022] DELETE /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:23.000043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:23.000750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] [instance: e0278953-274a-4642-b41e-84a99a1616dd] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:23.007289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.008035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.008498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.009257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.009700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.010305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.024289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] HTTP exception thrown: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Request method failure captured: Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd HTTP/1.1 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4iIBg1jzDy9ehTxe809PKcifA7EuK3Xxd9UbBD5Lipm5BDVK-zOJPLmULRjWTnKJ6uGvaXaPflOWEjDDRUg9bWK1JLlJ_4vgqlgB1M3WFG_ocjcdZDpvJqmsB-ioV7juWcz-b7OdoIyVuGgw_fKV33be33SYwSNaAIZeLJANjehB0 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:29:23.025915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b79bd8e6b84cd3a082d80b4aa3a546", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b79bd8e6b84cd3a082d80b4aa3a546"}]}] Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 77b79bd8e6b84cd3a082d80b4aa3a546 Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1117428830 Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: eca40eca0b6140a498e034e3e37a8c47 Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-DeleteServersTestJSON-1117428830-project Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:23.027320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'e0278953-274a-4642-b41e-84a99a1616dd'} Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:23.028134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. Aug 11 16:29:23.029288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:29:23.030265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] Returning 404 to user: Instance e0278953-274a-4642-b41e-84a99a1616dd could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:23.030265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed593f43-8573-45ee-9bb5-c22801dc8e1b tempest-DeleteServersTestJSON-1117428830 tempest-DeleteServersTestJSON-1117428830-project] 10.222.0.43 "GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd" status: 404 len: 111 microversion: 2.1 time: 0.034150 Aug 11 16:29:23.030265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 135/247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:22 2022] GET /compute/v2.1/servers/e0278953-274a-4642-b41e-84a99a1616dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:23.347322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:23.348018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:23.354533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.355022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.355460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.356172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.356627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.357082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.497077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:23.506268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d67d9add-c5e1-4b70-92cc-6e9436affa69 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.162045 Aug 11 16:29:23.507609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 113/248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:23 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:23.676352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:23.677636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:23.684782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.685263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.686392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.687100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:23.687550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:23.687971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:23.898470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:23.906106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-16cb8745-3005-4870-af0d-f6e98e5782f8 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1498 microversion: 2.1 time: 0.233738 Aug 11 16:29:23.906758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 136/249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:23 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:24.403030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:24.403754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:24.410620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.411234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.411962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.412894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.413441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.413920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.444008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:29:24.459042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:24.526949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:24.527509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:24.534478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.537738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.538367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.541084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.546019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.546377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.550946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02434942-b943-4ea1-9fa0-85c663fa6197 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 204 len: 0 microversion: 2.1 time: 0.151759 Aug 11 16:29:24.551536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 114/250] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:29:24 2022] DELETE /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:29:24.565666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:24.566618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:24.576282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.576986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.577463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.578238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:24.578846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:24.579338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:24.732620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:24.741734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:24.752353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6d923b15-e8a1-478d-8a2d-a779768e4ed1 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1504 microversion: 2.1 time: 0.193733 Aug 11 16:29:24.753623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a6848eb-6b75-4efa-a0f2-6579ac2784e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.230457 Aug 11 16:29:24.767482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 115/251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:24 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:24.768205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 137/252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:24 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:25.775718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:25.776302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:25.782285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:25.782886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:25.793026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:25.793504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:25.793935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:25.794626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:25.795069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:25.797907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:25.800062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:25.800567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:25.801012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:25.801671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:25.806634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:25.807090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:25.993525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:26.003033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ba4f3ef6-bf72-4605-a475-ca90666cbe40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.231534 Aug 11 16:29:26.004051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 116/253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:25 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:26.088907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:26.101540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f220cc7f-b927-4fae-a658-4deb7c8fb3a9 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1504 microversion: 2.1 time: 0.322561 Aug 11 16:29:26.107687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 138/254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:25 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:27.025454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:27.026074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:27.032511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:27.032982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:27.033408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:27.034076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:27.034526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:27.034938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:27.126494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:27.127285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:27.137566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:27.138057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:27.138485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:27.140076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:27.140076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:27.140286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:27.289040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:27.298794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-901a1842-e2fe-4eec-9f58-5fcdcbd03115 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 200 len: 1504 microversion: 2.1 time: 0.176306 Aug 11 16:29:27.299741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 139/255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:27 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:27.492249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca027421-b638-459a-b9f4-37749d801a0d", "name": "network-vif-deleted", "tag": "305a448d-6eda-4258-83e0-a98454191a64"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:27.509987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:27.517704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:27.523217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1939becf-16fe-4652-b319-c112db98d103 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.501992 Aug 11 16:29:27.536153 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 117/256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:27 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:27.536912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:27.536912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:27.539620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] Creating event network-vif-deleted:305a448d-6eda-4258-83e0-a98454191a64 for instance ca027421-b638-459a-b9f4-37749d801a0d on hv-cinder-85220 Aug 11 16:29:27.545091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-90927901-7217-4e0d-8121-f1915fe7dd40 req-804978eb-8d86-4223-8ffa-991b1664d761 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057683 Aug 11 16:29:27.546203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 140/257] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:28.322063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:28.322890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: ca027421-b638-459a-b9f4-37749d801a0d] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:28.330180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.330669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.331252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.331958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.332595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.333108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.347486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] HTTP exception thrown: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Request method failure captured: Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d HTTP/1.1 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S5SQp0eba9chdOUARq2EGaK2gnd6VtutMx3ZZRs0U6wodkz7AhelYc_H6fe_9F4YUzo4hI8Nf3WTLP9YgwcKkjjbCDawtqvazsscH0eG5P4h3n3yhOWaESm4E3-DXbgy1HBJwN13KKpfjrRWKpIjgJOf-A4YitIId6fIMHD6UJ6x40 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 26ff1514f2c240f0808f8aad188ac97f Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:29:28.349796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/26ff1514f2c240f0808f8aad188ac97f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26ff1514f2c240f0808f8aad188ac97f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_26ff1514f2c240f0808f8aad188ac97f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26ff1514f2c240f0808f8aad188ac97f"}]}] Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 26ff1514f2c240f0808f8aad188ac97f Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesActionsTest-1796692411-project Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 7d3bafbdaf274f33aef3c7d066eda6c8 Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesActionsTest-1796692411-project Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. Aug 11 16:29:28.351146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'ca027421-b638-459a-b9f4-37749d801a0d'} Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:28.351926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. Aug 11 16:29:28.353367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:28.355058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Returning 404 to user: Instance ca027421-b638-459a-b9f4-37749d801a0d could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:28.355058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-def035a2-8a0d-451b-95db-14b0aea7cc9f tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d" status: 404 len: 111 microversion: 2.1 time: 0.034431 Aug 11 16:29:28.355058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 118/258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:28 2022] GET /compute/v2.1/servers/ca027421-b638-459a-b9f4-37749d801a0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:28.489036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-654570148", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "networks": [{"uuid": "3611c47a-6371-460a-acc1-5e4d2297a682"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:28.549618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] validate_networks() for [('3611c47a-6371-460a-acc1-5e4d2297a682', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:29:28.550157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:28.550780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:28.561481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.562673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.563370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.564256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.564850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.565425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.737416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:28.747397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-96f5f471-735c-4ab4-9549-7b0fbf1ce3f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.203801 Aug 11 16:29:28.748187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 119/259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:28 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:28.941594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:29:28.942053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:29:28.943216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:29:28.943626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:29:28.944044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:29:28.955528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.956003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.960601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.960601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:28.960601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:28.960601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:28.984275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Getting quotas for project 26ff1514f2c240f0808f8aad188ac97f. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:29:28.988241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Getting quotas for user 7d3bafbdaf274f33aef3c7d066eda6c8 and project 26ff1514f2c240f0808f8aad188ac97f. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:29:28.999517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:29:29.002243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:29:29.058306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b582317-c4e5-400a-acd4-f45fb5cb35d5 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573725 Aug 11 16:29:29.060439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 141/260] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:29:29.071219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-537b72b4-5474-490e-a022-8d8bde9eb5d4 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:29.072256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-537b72b4-5474-490e-a022-8d8bde9eb5d4 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:29.165464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-537b72b4-5474-490e-a022-8d8bde9eb5d4 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:29.179073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-537b72b4-5474-490e-a022-8d8bde9eb5d4 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1213 microversion: 2.1 time: 0.109636 Aug 11 16:29:29.179813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 120/261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:29 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:29.767250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:29.767860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:29.777187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:29.778162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:29.779332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:29.780294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:29.780709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:29.781379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:29.953183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:29.960773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c7da975-c10c-493f-a5bf-2a4c8797a792 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.197351 Aug 11 16:29:29.961956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 142/262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:29 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:30.203063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:30.203860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:30.213712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:30.214480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:30.217038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:30.217925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:30.218556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:30.219160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:30.300656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:30.309260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6be694de-f36f-470e-b2d8-fb201d365e44 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1273 microversion: 2.1 time: 0.111152 Aug 11 16:29:30.321021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 121/263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:30 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:30.983547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:30.985476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:31.001972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:31.002660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:31.008764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:31.010166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:31.010537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:31.010978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:31.281344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:31.290045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-469cddba-a928-4a61-b2a8-ba10a3dfea07 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.311258 Aug 11 16:29:31.290630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 143/264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:30 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:31.335721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:31.337223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:31.344136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:31.344887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:31.345558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:31.346543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:31.347205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:31.347884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:31.649411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:31.657543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f9aaf40-5a28-4fe7-b1e7-5376592690ce tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.328016 Aug 11 16:29:31.658118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 122/265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:31 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:31.924850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802936cc-07f6-4c28-988e-da7802c37723", "tag": "ac21d9f7-617b-4e70-b6a4-060f10adc9b4"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:31.940600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:31.941146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:31.952277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:31.966665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] Creating event network-changed:ac21d9f7-617b-4e70-b6a4-060f10adc9b4 for instance 802936cc-07f6-4c28-988e-da7802c37723 on hv-cinder-85220 Aug 11 16:29:31.970272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-0385e55f-ec21-4482-9228-ba190e2230e8 req-df0a4590-e518-45af-be33-349ed57870c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049696 Aug 11 16:29:31.971047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 144/266] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:32.312360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:32.313147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:32.324139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:32.326131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:32.326573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:32.328878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:32.329346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:32.329773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:32.534345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:32.550318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ce6c9c9b-2a1c-4868-a695-68fb3954ab49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.241440 Aug 11 16:29:32.565865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 123/267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:32 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:32.680473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:32.681443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:32.691749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:32.691921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:32.696974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:32.697801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:32.698283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:32.698719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:32.968260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:32.971755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:32.977117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbb135c8-1548-47ee-a0b7-2370cd232d2a tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.302069 Aug 11 16:29:32.977688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 145/268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:32 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:33.575139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:33.575768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:33.583255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:33.583740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:33.584443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:33.585327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:33.585784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:33.586211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:33.822487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:33.843987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1d981f5d-75ff-435a-b916-78ec7d9e1c3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.272866 Aug 11 16:29:33.846737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 124/269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:33 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:34.002193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:34.002939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:34.014112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:34.014852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:34.015498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:34.016750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:34.017422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:34.018214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:34.428822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:34.438352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f566654c-549a-40f4-8bd5-475894e6f6c0 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.443573 Aug 11 16:29:34.450314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 146/270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:33 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:34.869194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:34.870540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:34.878046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:34.879136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:34.880656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:34.881763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:34.882527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:34.883164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:35.041482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:35.050525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-47fe2bae-8a27-4f17-9e31-76151c8dc2e3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.187174 Aug 11 16:29:35.053397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 125/271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:34 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:35.461403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:35.462201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:35.469668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:35.470574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:35.471243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:35.471979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:35.472834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:35.473385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:35.677830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:35.686300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-477d23fd-b3e2-4317-8a99-94514460baed tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.229514 Aug 11 16:29:35.696135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 147/272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:35 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:36.073842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:36.074468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:36.081127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:36.081618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:36.082054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:36.082806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:36.083579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:36.084241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:36.254029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:36.264303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-23394369-43b7-458e-ad17-d40ebe7d47a1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.194119 Aug 11 16:29:36.272736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 126/273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:36 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:36.710760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:36.711292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:36.717193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:36.717677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:36.718124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:36.718784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:36.719235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:36.719651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:36.949528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:36.957158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44e07335-5528-4393-98df-3254537b3364 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.251409 Aug 11 16:29:36.958633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 148/274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:36 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:37.287435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:37.288445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:37.296278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:37.297244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:37.297708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:37.298698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:37.299148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:37.299605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:37.604352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:37.613622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0991e811-c668-44bd-9bfe-0a85bee78115 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.331218 Aug 11 16:29:37.616343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 127/275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:37 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:37.982823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:37.984225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:37.993888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:37.995016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:37.996018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:37.997429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:37.998510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:37.999451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:38.211764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:38.226713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9177e60c-a2ab-4e78-859b-d39f6b3daf3d tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.247479 Aug 11 16:29:38.227891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 149/276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:37 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:38.258731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802936cc-07f6-4c28-988e-da7802c37723", "name": "network-vif-plugged", "status": "completed", "tag": "ac21d9f7-617b-4e70-b6a4-060f10adc9b4"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:38.269076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:38.269796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:38.271755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:38.288585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] Creating event network-vif-plugged:ac21d9f7-617b-4e70-b6a4-060f10adc9b4 for instance 802936cc-07f6-4c28-988e-da7802c37723 on hv-cinder-85220 Aug 11 16:29:38.294289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-69378849-2b62-4963-af44-5021a7bf0c27 req-0f3568ab-47fa-4eee-a817-f1c2539c9d36 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040773 Aug 11 16:29:38.295579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 128/277] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:38.641852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:38.645050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:38.654805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:38.655333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:38.655762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:38.661719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:38.662814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:38.664019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:38.909372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:38.918591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5689304e-8c7d-4672-864e-96942374670a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.284120 Aug 11 16:29:38.938294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 150/278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:38 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:39.253865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:39.256979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:39.261420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:39.267902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:39.268410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:39.268899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:39.273026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:39.273573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:39.274285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:39.603708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:39.615005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d175a420-2927-4787-805e-58ea8a121a7c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.366524 Aug 11 16:29:39.629045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 129/279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:39 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:39.945676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:39.946817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:39.948773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:39.949424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:39.955251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:39.955667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:39.956114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:39.956809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:39.957254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:39.958317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:40.188365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:40.199364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c19eecae-b0a9-4b25-94b3-970f7e8a5dcc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.257982 Aug 11 16:29:40.202627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 151/280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:39 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:40.637302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:40.639294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:40.649018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:40.653296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:40.655514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:40.658076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:40.661002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:40.663713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:40.664992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:40.901001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:40.910145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0d55b573-dffd-4e55-907d-3781bd2abd93 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1313 microversion: 2.1 time: 0.277047 Aug 11 16:29:40.911313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 130/281] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:40 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:41.224387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:41.225544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:41.227581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:41.239270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:41.241663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:41.242327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:41.243834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:41.244520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:41.245153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:41.462149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:41.470677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44d3f81e-bdef-4001-8b16-d6b0df062c94 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.250787 Aug 11 16:29:41.471612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 152/282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:41 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:41.937404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:41.938816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:41.950482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:41.951539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:41.951991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:41.953256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:41.953762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:41.954182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:42.143013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:42.154008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ce18fab5-ed50-421b-a2ce-2d3c13c98576 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1497 microversion: 2.1 time: 0.224777 Aug 11 16:29:42.168826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 131/283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:41 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:42.275923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a3e58568-6025-472f-8dda-79f94a5ac364 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Action: 'create', calling method: .version_select at 0x7f614363fd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-584603698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHNEr8zZxOqz0T0XlhXfPQruXHm1WMIB6/ipuyW15sz4DWwv15sXlqm50WebNo7eAhzcHr29bxfvYiNaEE3ImGKiZDGe/5lVJ+XOl0kLNB0hZaD6hpRVMCtDnxn5mGtA=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:42.293248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a3e58568-6025-472f-8dda-79f94a5ac364 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Getting quotas for project ab0c02c8d1fa4a9fbbb64a655643ff31. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:29:42.297722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-a3e58568-6025-472f-8dda-79f94a5ac364 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Getting quotas for user ea2b7595ca6d446c84e95a05a701e9dc and project ab0c02c8d1fa4a9fbbb64a655643ff31. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:29:42.325048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a3e58568-6025-472f-8dda-79f94a5ac364 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.294209 Aug 11 16:29:42.326173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 153/284] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:29:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:42.498374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:42.499636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:42.506169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:42.506647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:42.507078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:42.507791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:42.508267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:42.508681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:42.702491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:42.787276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:42.787910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:42.807811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:42.808625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:42.809436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:42.810344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:42.811719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:42.812347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:42.842701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:29:42.870700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:42.890512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-072f0046-d990-41c9-bba6-98bac2040cd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.399080 Aug 11 16:29:42.903275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 132/285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:42 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:42.966946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f48426f9-ecf3-4c17-854c-46c2cb1f08ec tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "DELETE /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 204 len: 0 microversion: 2.1 time: 0.184625 Aug 11 16:29:42.978820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 154/286] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:29:42 2022] DELETE /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 16:29:42.991616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:42.992263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:43.000287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:43.000631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:43.001057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:43.001863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:43.002312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:43.002728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:43.251847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:43.263121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-99855788-1422-46e7-be90-56dad3d03d31 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1503 microversion: 2.1 time: 0.281334 Aug 11 16:29:43.263908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 133/287] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:42 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:43.916124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:43.918110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:43.925139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:43.925633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:43.926105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:43.927190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:43.927721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:43.928171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:44.108333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:44.116926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8e2f326-5a50-4aa0-b33a-75c61ed65a38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.206396 Aug 11 16:29:44.117491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 155/288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:43 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:44.285999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:44.287530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:44.293542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:44.294026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:44.294506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:44.295214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:44.295658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:44.296080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:44.466221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:44.474787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e8acc4f2-cd38-45bc-afb2-19281315c25c tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1503 microversion: 2.1 time: 0.193332 Aug 11 16:29:44.475636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 134/289] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:44 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:45.138703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:45.139307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:45.147633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.148163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.148573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.149270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.149716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.150137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.293144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802936cc-07f6-4c28-988e-da7802c37723", "name": "network-vif-deleted", "tag": "ac21d9f7-617b-4e70-b6a4-060f10adc9b4"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:45.303872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.304658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.305238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.319428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] Creating event network-vif-deleted:ac21d9f7-617b-4e70-b6a4-060f10adc9b4 for instance 802936cc-07f6-4c28-988e-da7802c37723 on hv-cinder-85220 Aug 11 16:29:45.325226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-d94a1022-f93e-422f-a770-fc811cd372fd req-555bcf83-53c5-412d-82a4-2ab4613a7590 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Aug 11 16:29:45.326017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 135/290] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:29:45.389321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:45.398922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4f3f62f-a5d2-4801-8ad6-35fb2b22a658 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.263822 Aug 11 16:29:45.399808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 156/291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:45 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:45.500912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:45.501617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:45.508783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.509270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.509772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.510498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.511095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.511650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.545021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:45.545845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:45.546254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:45.546848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lazy-loading 'fault' on Instance uuid 802936cc-07f6-4c28-988e-da7802c37723 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:29:45.590727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3bafbdaf274f33aef3c7d066eda6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ff1514f2c240f0808f8aad188ac97f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:45.598880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f1b485da-d122-4210-ba3b-eda88bae6381 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 200 len: 1303 microversion: 2.1 time: 0.102430 Aug 11 16:29:45.600031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 136/292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:45 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:46.419955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:46.420603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:46.426750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:46.427379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:46.427707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:46.428430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:46.428884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:46.429302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:46.570384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:46.577956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-326a336e-06ee-4f41-bf3f-b5ce7b14b493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.161954 Aug 11 16:29:46.584142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 157/293] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:46 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:46.620572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:46.621185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] [instance: 802936cc-07f6-4c28-988e-da7802c37723] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:46.627668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:46.628206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:46.628647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:46.629912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:46.630374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:46.631006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:46.644284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] HTTP exception thrown: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Request method failure captured: Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 HTTP/1.1 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S5SQp0eba9chdOUARq2EGaK2gnd6VtutMx3ZZRs0U6wodkz7AhelYc_H6fe_9F4YUzo4hI8Nf3WTLP9YgwcKkjjbCDawtqvazsscH0eG5P4h3n3yhOWaESm4E3-DXbgy1HBJwN13KKpfjrRWKpIjgJOf-A4YitIId6fIMHD6UJ6x40 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 26ff1514f2c240f0808f8aad188ac97f Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:29:46.646732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/26ff1514f2c240f0808f8aad188ac97f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26ff1514f2c240f0808f8aad188ac97f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_26ff1514f2c240f0808f8aad188ac97f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26ff1514f2c240f0808f8aad188ac97f"}]}] Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 26ff1514f2c240f0808f8aad188ac97f Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesActionsTest-1796692411 Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesActionsTest-1796692411-project Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 7d3bafbdaf274f33aef3c7d066eda6c8 Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesActionsTest-1796692411-project Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. Aug 11 16:29:46.648426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '802936cc-07f6-4c28-988e-da7802c37723'} Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:29:46.649278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. Aug 11 16:29:46.650578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:29:46.651798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] Returning 404 to user: Instance 802936cc-07f6-4c28-988e-da7802c37723 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:29:46.651798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eb592e2d-85ee-4957-9e01-6904a2da1301 tempest-VolumesActionsTest-1796692411 tempest-VolumesActionsTest-1796692411-project] 10.222.0.43 "GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723" status: 404 len: 111 microversion: 2.1 time: 0.031458 Aug 11 16:29:46.651798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 137/294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:46 2022] GET /compute/v2.1/servers/802936cc-07f6-4c28-988e-da7802c37723 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:29:47.600351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:47.600971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:47.608701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:47.609198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:47.609642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:47.610339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:47.610788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:47.611200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:47.773008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:47.782516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-919ca281-dc51-40d2-b3ec-2ee62566a5c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.187300 Aug 11 16:29:47.783101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 158/295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:47 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:29:48.805265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:48.805877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:48.812616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:48.813100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:48.813533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:48.814219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:48.814667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:48.815089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:48.974498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:48.983397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-14e49cac-8adf-4c1a-a834-8b646fd20c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.182493 Aug 11 16:29:48.984014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 138/296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:48 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:50.004881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:50.005491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:50.011558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:50.012032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:50.012491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:50.013168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:50.013610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:50.014027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:50.142228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:50.150766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76a0a1f5-aa4f-42c6-b84a-351dcd2f9920 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.149863 Aug 11 16:29:50.151323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 159/297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:49 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:51.170822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:51.171460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:51.178854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:51.179359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:51.179798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:51.180516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:51.180968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:51.181646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:51.315892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:51.323906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0147274a-2a05-4b94-a1be-563f7dfe78b5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1522 microversion: 2.1 time: 0.156981 Aug 11 16:29:51.324528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 139/298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:51 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:52.346530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:52.347335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:52.351545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:52.362307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:52.362838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:52.363299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:52.364550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:52.365127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:52.365398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:52.533206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:52.542495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d4c1b0c-c4d7-41e0-8c4c-51a82e10e04d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1502 microversion: 2.1 time: 0.200562 Aug 11 16:29:52.543463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 160/299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:52 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:52.567751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:52.568994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:52.577016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:52.577520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:52.578105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:52.579001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:52.579464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:52.580024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:52.718776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:52.727430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e776d310-9987-4b28-8904-1977d45cdd0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1516 microversion: 2.1 time: 0.167426 Aug 11 16:29:52.728242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 140/300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:52 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:54.287231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:54.290509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:54.296738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.297225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.297657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.298351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.298804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.299226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.323939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'flavor' on Instance uuid aad28131-4298-4448-bdb8-74313c3bf525 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:29:54.355037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:29:54.450695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e3b76be-468e-46a4-b567-c454537cb30e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/action" status: 200 len: 32 microversion: 2.1 time: 0.168573 Aug 11 16:29:54.451464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 161/301] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:29:54 2022] POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 16:29:54.463156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:54.464550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:54.474516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.475422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.476030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.476939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.477886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.478463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.641929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:54.642680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:54.649883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.650507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.651040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.652007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:54.652583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:54.653106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:54.678749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75513184-2537-4d29-94b1-f02287a91600 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/ips" status: 200 len: 144 microversion: 2.1 time: 0.040865 Aug 11 16:29:54.684649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 162/302] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:29:54 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/ips => generated 144 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:54.742745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:54.755391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7ea7e168-ef52-4ede-955f-a6192a2c4382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.295156 Aug 11 16:29:54.768394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 141/303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:54 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:55.784288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:55.785591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:55.792483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:55.793216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:55.793874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:55.794552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:55.795390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:55.795833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:56.053960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:56.064050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0680e498-ef8e-469c-b7d1-09eaa93bdd45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.284624 Aug 11 16:29:56.066913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 163/304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:55 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:57.094366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:57.095040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:57.103877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:57.104977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:57.106165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:57.107037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:57.107701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:57.108419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:57.373078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:57.381821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ee852179-f4b5-4be7-9dbd-615e3d39b09f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.293091 Aug 11 16:29:57.382960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 142/305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:57 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:57.599319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2f77f2-0622-4a7a-a20a-78d7283f3cfb"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:29:57.601747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:57.608587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:57.609150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:57.610656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:57.611372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:57.611826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:57.612471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:58.235979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28e3165a-7d12-4960-9f01-7d4fa623da25 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640862 Aug 11 16:29:58.237149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 164/306] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:29:57 2022] POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:29:58.405295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:58.406209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:58.425335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:58.428636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:58.428636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:58.429675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:58.431805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:58.433202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:58.612475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:58.622666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-404a2429-88d7-48c8-963b-be7922efd9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.221694 Aug 11 16:29:58.623242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 143/307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:58 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:29:59.648308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:29:59.649013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:29:59.655321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:59.655806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:59.656274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:59.657172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:29:59.657787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:29:59.658370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:29:59.823998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:29:59.833232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-346abcc7-dc76-4dd0-8133-31b1673b3f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.190511 Aug 11 16:29:59.834342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 165/308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:29:59 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:00.858108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:00.858802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:00.869655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:00.870061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:00.870858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:00.871797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:00.872500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:00.873343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:01.072035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:01.081656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ad03a5b0-b16c-4840-b367-eea1019ddde3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.228958 Aug 11 16:30:01.083502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 144/309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:00 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:02.104644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:02.105249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:02.111633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:02.112158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:02.112603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:02.113473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:02.114046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:02.114476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:02.262465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:02.270939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8854b7c2-0932-46cf-b4a3-150fad8cb98e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.170054 Aug 11 16:30:02.271585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 166/310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:02 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:03.293004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:03.294261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:03.302513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:03.303247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:03.303853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:03.304780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:03.305395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:03.305981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:03.480549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:03.492704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3af23e8f-01e5-4195-b350-3df104402f19 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.204517 Aug 11 16:30:03.505206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 145/311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:03 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:04.515317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:04.516057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:04.526594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:04.527085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:04.527631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:04.528384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:04.528844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:04.529277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:04.675409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:04.683897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0c9f99a-e441-4b72-bff2-00781c3ef565 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.172377 Aug 11 16:30:04.684801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 167/312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:04 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:05.705758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:05.706484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:05.713208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:05.713773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:05.714302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:05.715072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:05.715608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:05.716122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:05.861919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:05.871178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a9ce006a-9efd-4c29-a3b7-ff68ad8435d3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.169606 Aug 11 16:30:05.872974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 146/313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:05 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:05.960977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:05.968603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:05.969097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:05.969535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:06.063947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Going to try to stop instance {{(pid=120731) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 16:30:06.157861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc570462-80f5-4cb9-8a9e-a69110080b6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action" status: 202 len: 0 microversion: 2.1 time: 0.200905 Aug 11 16:30:06.159135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 168/314] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:30:05 2022] POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:30:06.178739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:06.179423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:06.186288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:06.187147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:06.187828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:06.188637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:06.189166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:06.189663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:06.366258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:06.376649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d9553066-21d4-4714-b6bb-aa944b742f9c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.212934 Aug 11 16:30:06.377225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 147/315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:06 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:06.905339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:06.906113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:06.913333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:06.913974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:06.914554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:06.915525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:06.916195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:06.916621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:07.089395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:07.097667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-656e5450-7fa4-448f-bc33-a7559daa4a65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.198326 Aug 11 16:30:07.098551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 169/316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:06 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:07.366753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:07.368216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:07.375613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:07.376488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:07.377195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:07.377979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:07.379182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:07.379896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:07.399582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:07.400564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:07.408921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:07.412203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7937ad8d-92a8-4e53-91f2-9824515f5721 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.049593 Aug 11 16:30:07.413052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 148/317] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:30:07 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:07.414564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:07.415027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:07.415772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:07.416438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:07.416874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:07.609386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:07.621136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2ee337d-f7ff-41a5-98fb-86f1d6086ff3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.226640 Aug 11 16:30:07.635387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 170/318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:07 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:08.118334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:08.118940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:08.124853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:08.125335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:08.125796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:08.126529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:08.126924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:08.127341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:08.253182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:08.261484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b2eb84e9-cbac-46d4-969f-f299c8bf218d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.146956 Aug 11 16:30:08.262044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 149/319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:08 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:08.643112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:08.643713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:08.650365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:08.650843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:08.651271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:08.651949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:08.652431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:08.652851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:08.787564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:08.796060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-304a7489-8219-4382-b0a7-a9e746d9eefc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.156825 Aug 11 16:30:08.796806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 171/320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:08 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:09.284050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:09.285531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:09.292534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:09.293068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:09.293732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:09.294648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:09.295195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:09.295812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:09.314609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:09.442022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:09.450087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6e32b85c-d3ad-41f2-8bcc-ab6be1d41afe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.170782 Aug 11 16:30:09.451103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 150/321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:09 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:09.825818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:09.826621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:09.843733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:09.844769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:09.845982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:09.849387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:09.850399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:09.852345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:10.024069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb194d16-400c-4811-8aac-a06b5d062531"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:10.026519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:10.038653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:10.039560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:10.040345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:10.041307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:10.042063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:10.042681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:10.111029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:10.135456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-521d862e-6c32-401c-a53d-36f2bf3f6d31 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.316190 Aug 11 16:30:10.137247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 172/322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:09 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:10.147595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-759857107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-584603698", "security_groups": [{"name": "tempest-secgroup-smoke-162186639"}], "block_device_mapping_v2": [{"uuid": "3ad1fdab-53c5-4584-a2ce-d3022c70a2b6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3c417dbf-2b7b-47da-a0ca-a3266d9f1c1d"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:10.351671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] validate_networks() for [('3c417dbf-2b7b-47da-a0ca-a3266d9f1c1d', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:30:10.467634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-23aaf2cd-301c-4822-bfd2-6e0dc17dfc73 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447546 Aug 11 16:30:10.470627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 151/323] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:30:10 2022] POST /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:10.495958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:10.499596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:10.524761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:10.525378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:10.525902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:10.526548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:10.526999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:10.527420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:10.875101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:10.885627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-09ed9720-2af8-4d8f-a278-200d73d3e44c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.411747 Aug 11 16:30:10.886284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 152/324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:10 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:11.015539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:30:11.016617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:30:11.017627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:30:11.018080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:30:11.018501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:30:11.034981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.035259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.035708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:11.036460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.036913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.037458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:11.060508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Getting quotas for project ab0c02c8d1fa4a9fbbb64a655643ff31. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:11.064816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Getting quotas for user ea2b7595ca6d446c84e95a05a701e9dc and project ab0c02c8d1fa4a9fbbb64a655643ff31. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:11.166618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:11.167355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:11.174380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=48 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:11.178084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.179051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.182702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:11.183633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.184059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.184521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:11.197317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:30:11.199389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ad1fdab-53c5-4584-a2ce-d3022c70a2b6',volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:30:11.377051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:11.424776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29d3ad04-bdb6-4b2f-ba51-495c09a810ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.285644 Aug 11 16:30:11.426488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 173/325] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:30:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:30:11.438678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4778a546-5f92-4acf-b003-8e79e5ee316e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:11.439676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4778a546-5f92-4acf-b003-8e79e5ee316e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:11.456048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:11.467718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6107aa63-efbb-4581-b23f-be187873d697 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.305752 Aug 11 16:30:11.471534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 153/326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:11 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:11.530663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4778a546-5f92-4acf-b003-8e79e5ee316e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:11.539019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4778a546-5f92-4acf-b003-8e79e5ee316e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1093 microversion: 2.1 time: 0.104556 Aug 11 16:30:11.539596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 174/327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:11.916072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:11.917578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:11.930151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.931537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.933090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:11.934632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:11.937639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:11.940057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:12.212670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:12.237572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-43947c25-1189-43e9-9ec8-c38aa9ec2418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.332688 Aug 11 16:30:12.239945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 154/328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:11 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:12.494390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:12.495085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:12.504640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:12.505446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:12.505948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:12.506722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:12.507275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:12.507759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:12.567700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:12.568974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:12.575897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:12.576697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:12.577320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:12.578272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:12.578894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:12.579476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:12.652565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:12.663511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-92b12208-c5a4-436c-8745-24884f409c6e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1191 microversion: 2.1 time: 0.105940 Aug 11 16:30:12.664975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 155/329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:12 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:12.740030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:12.749219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6710fe04-0111-4abb-a3db-629a57c982f7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.258668 Aug 11 16:30:12.763263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 175/330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:12 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:13.261316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:13.262487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:13.277174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.279206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.280846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.281789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.287474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.288233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.468226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:13.468824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:13.502999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.505111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.505746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.509664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.512888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.513855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.524176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:13.580936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c11b4ab-893f-4847-8f1d-f05e3fba951d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/ips" status: 200 len: 151 microversion: 2.20 time: 0.120348 Aug 11 16:30:13.581229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:13.582935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 176/331] 10.222.0.43 () {60 vars in 1289 bytes} [Thu Aug 11 16:30:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:30:13.599754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-29d3e623-f508-4287-b05b-ec7f36d9d691 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.339168 Aug 11 16:30:13.600646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 156/332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:13 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:13.700060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:13.701996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:13.723307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.724072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.730914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.733201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.736087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.737033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.773484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:13.774349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:13.799373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.804481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.805115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:13.808606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:13.812201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:13.814429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:14.134526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:14.143455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ed341e4-8aa3-45ae-b1f1-76a54ec15c68 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1276 microversion: 2.1 time: 0.455913 Aug 11 16:30:14.144124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 177/333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1276 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:14.623124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:14.625070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:14.631411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:14.639763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:14.640680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-75c5b48c-bdfc-4cb1-a857-291fd0ba4c8a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.874036 Aug 11 16:30:14.648504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:14.649375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:14.652769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 157/334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:13 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:14.656380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:14.657144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:14.658381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:15.174976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:15.175925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:15.193613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:15.194341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:15.199942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:15.200955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:15.214320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:15.214812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:15.216587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:15.247852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a7bb7c0-c55a-493f-b063-d2f48f35a25c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.628428 Aug 11 16:30:15.249023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 178/335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:14 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:15.670263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:15.679751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:15.680401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:15.683126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5b93dc75-73e9-430a-a793-03973dd9858c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1276 microversion: 2.1 time: 0.511925 Aug 11 16:30:15.684265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 158/336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1276 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:15.702911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:15.703993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:15.708778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:15.709541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:15.710017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:15.710447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:15.945088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:15.959197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e581742-858b-4f23-948c-e49d796a10da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.299867 Aug 11 16:30:15.972725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 179/337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:15 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:16.094926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79e2fbc-243f-414d-a640-f814f64e7947", "tag": "5a8308f7-463f-4fc0-b4bb-809bb832b03f"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:16.122796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.123946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.127688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.158101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] Creating event network-changed:5a8308f7-463f-4fc0-b4bb-809bb832b03f for instance b79e2fbc-243f-414d-a640-f814f64e7947 on hv-cinder-85220 Aug 11 16:30:16.167118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-01aaa5a3-d149-481e-b4e6-5ddb594c5d71 req-a4844742-c01e-42d7-a7e5-6eee03102a69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078390 Aug 11 16:30:16.171340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 159/338] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:30:16.271820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:16.272475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:16.286351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.293169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.294110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.295988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.298003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.299193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.495365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:16.505555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e70d1ed-ddb3-4111-aed5-20d3f59e91fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.238938 Aug 11 16:30:16.506900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 180/339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:16 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:16.714037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:16.715435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:16.723938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.724881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.725591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.734526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.735165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.735762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.929965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:16.938631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4651acb8-d438-4bd7-8040-cb852398d641 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1276 microversion: 2.1 time: 0.230196 Aug 11 16:30:16.939200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 160/340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:16 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:16.982015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:16.982556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:16.989696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.990331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.990759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:16.991476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:16.992008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:16.992547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.136357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:17.145988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-01837c76-75e8-4da1-ac68-35865dd0578a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.168249 Aug 11 16:30:17.146556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 181/341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:16 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:17.242041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:17.242661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:17.255335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.255823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.256295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.257007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.257459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.261658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.296005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lazy-loading 'flavor' on Instance uuid 228fe15a-7159-4dbe-89fa-2340fc3c0558 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:30:17.526852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:17.527467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:17.535360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.536407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.537081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.537837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.539196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.539700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.551696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2c97610c-7f21-4c60-bc26-1cbb0d661f24 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action" status: 202 len: 0 microversion: 2.20 time: 0.314182 Aug 11 16:30:17.552412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 161/342] 10.222.0.43 () {62 vars in 1319 bytes} [Thu Aug 11 16:30:17 2022] POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:30:17.565779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:17.567703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:17.577355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.578598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.579390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.580219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.580884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.581636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.804547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:17.813614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c8ad8b2-8113-400a-ad83-6aee254df6fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.290606 Aug 11 16:30:17.814889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 182/343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:17 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:17.960371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:17.961205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:17.971838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.975075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.975249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:17.975819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:17.976354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:17.976801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:18.088305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:18.113008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:18.117263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:18.119998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dfc99de5-5642-42b5-96bc-3256189027c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.561859 Aug 11 16:30:18.135042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 162/344] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:18.170245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:18.171268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:18.192695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:18.194211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:18.196544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:18.198222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:18.199824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:18.201923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:18.203174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:18.217209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-08af9260-e836-45b3-b2af-383364a0d83d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1276 microversion: 2.1 time: 0.261734 Aug 11 16:30:18.217891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 183/345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:18.492560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:18.500692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2b550485-d706-462d-a4ef-9ad7c0e0d69f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.336886 Aug 11 16:30:18.501581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 163/346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:18 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:18.631512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-14d50f94-36bc-45bb-b756-85f888130985 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: .version_select at 0x7f61480cc670>, body: {"keypair": {"name": "tempest-keypair-91804665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9pv/aQdez3y1UQCK5azd4P/AaYxNns7M4ok4TPWKSoA1pmNVbS1xUyIIighMsJXRaUiY1O9EDfe6P8RCvOpUB0Rda+8Ld8YpvQZL8j7HwwpBNzFF4BEPHPnJSDQ1JlwQ=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:18.648072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-14d50f94-36bc-45bb-b756-85f888130985 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:18.653145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-14d50f94-36bc-45bb-b756-85f888130985 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:18.682143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-14d50f94-36bc-45bb-b756-85f888130985 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.055821 Aug 11 16:30:18.683685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 184/347] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:30:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:18.837558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:18.838113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:18.846123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:18.846715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:18.848010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:18.849106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:18.849852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:18.850332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:18.890780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:19.077826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.087326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ee33cb45-0aad-4f98-ae33-5a8e8a4c8753 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.255517 Aug 11 16:30:19.087897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 164/348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:18 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:19.149320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:19.150010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:19.156839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.157400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.157906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.158681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.159205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.159741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.242455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:19.243076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:19.256440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.256967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.257401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.258095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.259010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.259534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.299372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.308631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.310212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.311475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68063834-40e7-44d1-b0f7-d41dee9aef9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.166622 Aug 11 16:30:19.312119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 185/349] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:19.480556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.490324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6117b06f-71e3-484a-8c1d-a7900f7754a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.254508 Aug 11 16:30:19.491172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 165/350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:19 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:19.523912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:19.524537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:19.532089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2138604296", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "networks": [{"uuid": "5c40a0da-265a-40a9-8468-1fae6995f12d"}]}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:19.543471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.543960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.544422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.545122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:19.545570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:19.545984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:19.591762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] validate_networks() for [('5c40a0da-265a-40a9-8468-1fae6995f12d', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:30:19.682291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:19.690649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b51635ab-c2cc-4601-a8af-b49aabffdd05 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.171054 Aug 11 16:30:19.691401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 186/351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:19 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:20.109003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:20.109649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:20.117819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.118668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.119328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.120143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.120801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.121569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.197124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:30:20.199523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:30:20.200160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:30:20.200708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:30:20.201265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:30:20.210634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.211436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.211971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.213198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.213762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.214303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.234399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Getting quotas for project 92e71ba59c6d42dabeef49f62cebac1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:20.239376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Getting quotas for user 992a34be52b7491da0b68cbe17f25b39 and project 92e71ba59c6d42dabeef49f62cebac1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:20.252481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:30:20.255835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:30:20.311570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5438933e-c909-438b-a4eb-3a317f3b9e24 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783126 Aug 11 16:30:20.312498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 166/352] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:30:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:30:20.338669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9cf7219c-5af1-45b8-939b-4fdc924e0566 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:20.340183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9cf7219c-5af1-45b8-939b-4fdc924e0566 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:20.437721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9cf7219c-5af1-45b8-939b-4fdc924e0566 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.448471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9cf7219c-5af1-45b8-939b-4fdc924e0566 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1219 microversion: 2.1 time: 0.121272 Aug 11 16:30:20.449371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 167/353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:20 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:20.455205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:20.456197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:20.466276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.467286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.468144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.468480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.470027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.471007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.472405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.480196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1508eb7a-2ab0-4d21-bde2-458e0e33b31f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.375076 Aug 11 16:30:20.480793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 187/354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:20 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:20.514615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:20.517642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:20.533577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.534081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.535156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.536345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.537098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.537851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.679431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.691303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.693894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.696121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-369617c4-f1f0-4b90-82bc-89816d533b65 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.245419 Aug 11 16:30:20.697139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 168/355] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:20.704183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-144638366", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247ee74-ce66-47ac-ae21-9c4793c44289"}], "security_groups": [{"name": "tempest-securitygroup--1352046285"}], "key_name": "tempest-keypair-91804665", "user_data": "}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:20.720021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.732499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd553f0c-eb49-4537-be21-916faf0620d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.223848 Aug 11 16:30:20.735011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 188/356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:20.742481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:20.743599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:20.755549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.756052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.756543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.757255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:20.757711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:20.758208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:20.847930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] validate_networks() for [('6247ee74-ce66-47ac-ae21-9c4793c44289', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:30:20.974013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:20.986068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72b384de-e2a1-4c82-b826-c8b0f1f0f751 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.249392 Aug 11 16:30:20.986906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 189/357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:20 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:21.306638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:30:21.307105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:30:21.307532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:30:21.307946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:30:21.308385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:30:21.318192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.318675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.319108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.319951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.324647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.325098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.344905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:21.349049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:21.360165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:30:21.362233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:30:21.411893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f3b86204-ba7c-4084-8d30-5f05447db2e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.713170 Aug 11 16:30:21.412576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 169/358] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:30:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:30:21.423056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c90da9c-b4f6-4c24-8e16-4d90a7859954 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:21.423642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c90da9c-b4f6-4c24-8e16-4d90a7859954 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:21.426128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:21.477164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:21.478201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:21.480659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3c90da9c-b4f6-4c24-8e16-4d90a7859954 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.486826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.488057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.488372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c90da9c-b4f6-4c24-8e16-4d90a7859954 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1239 microversion: 2.1 time: 0.068312 Aug 11 16:30:21.488909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.492147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 190/359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:21 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:21.493856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.494512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.495107 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.501830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:21.507190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:21.513935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.514421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.514855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.515549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.516134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.516442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.596165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.606672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1c8cd351-12ff-4b5d-afd8-75d17a39f20a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1271 microversion: 2.1 time: 0.133250 Aug 11 16:30:21.607680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 170/360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:21 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:21.680174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.688940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-406c363d-4838-4fe6-87b9-ddd6e8afe20a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.190849 Aug 11 16:30:21.689833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 191/361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:21 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:21.722023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:21.722732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:21.729863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.730346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.730780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.731646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.732315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.732907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.755376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:21.756021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:21.764802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.765558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.766053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.766777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:21.767235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:21.767665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:21.908136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.917653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.920616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.922103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6c276e52-4654-427f-8dd6-328c7f8a7b3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.204027 Aug 11 16:30:21.923278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 171/362] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:21.931884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:21.941598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dac189eb-4371-4a9d-9a50-5a0c9602cd9b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.189870 Aug 11 16:30:21.942263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 192/363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:22.010370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.010984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.016937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.017415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.017859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.018552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.019102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.019602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.160066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:22.168270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8e73cd13-4d8a-43e2-a065-2d5f5348c0ed tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.161736 Aug 11 16:30:22.168833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 172/364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:22.509115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.509723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.516148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.516625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.517050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.517729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.518183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.518599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.578825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:22.586480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df7e98e6-bec9-4b55-94c3-a85736c88b3e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1243 microversion: 2.1 time: 0.081399 Aug 11 16:30:22.587036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 193/365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1243 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:22.629201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.629838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.638743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.639227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.639659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.640376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.640826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.641406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.714273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.715000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.725598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:22.727600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.728116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.728561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.729260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.729715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.730138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.734384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a787720a-fe07-48ab-8e7a-8746a97b480c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1271 microversion: 2.1 time: 0.110126 Aug 11 16:30:22.735470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 173/366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:22.879841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:22.890844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e6e0bcab-cb96-47bd-8628-e0fe3f8bf481 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.181854 Aug 11 16:30:22.892215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 194/367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:22.947763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.948320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.954625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.955120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.955538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.956981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.957836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.958376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.963415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:22.964137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:22.970005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.970480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.970904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.971584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:22.972869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:22.973291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:22.977718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:23.094315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.103136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.104763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.106035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9c92b0cf-b78f-4aa6-ab4a-c64c9f110d22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.162283 Aug 11 16:30:23.106666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 174/368] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:23.114715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.124339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f5583f09-3c3e-4f99-9936-b5087b7708be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.164624 Aug 11 16:30:23.124909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 195/369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:23.190106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:23.191400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:23.197503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.197922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.198354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.199044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.199501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.199920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.330224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.339199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-70586521-d711-4fc8-a60b-e7cc3e1435ba tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.152913 Aug 11 16:30:23.339770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 175/370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:23 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:23.605635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-970742705", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:23.612521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:23.613837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:23.624047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.624890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.625607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.626874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.628822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.629458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.668150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] validate_networks() for None {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:30:23.739755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.748991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-113e9f9b-d5c5-4c54-8da6-6e45476a7bc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1309 microversion: 2.1 time: 0.144948 Aug 11 16:30:23.764578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 176/371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:23 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:23.771041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:23.771655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:23.777770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.778247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.778858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.779552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.779999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.780637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.868973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:23.897071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a702669f-673a-445a-b3d0-9f6094e1be3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1277 microversion: 2.1 time: 0.131017 Aug 11 16:30:23.897822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 177/372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:23 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:23.914699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:23.915488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:23.921775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.922320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.922820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.924008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.924162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.924843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.979578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:30:23.980009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:30:23.980512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:30:23.982901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:30:23.983348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:30:23.993582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.994064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.994495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:23.995383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:23.995840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:23.996298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.018283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Getting quotas for project 0550e07d9e474e5485aa01188de165b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:24.023490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Getting quotas for user b7831d3847004751880cdda8d2e6ef27 and project 0550e07d9e474e5485aa01188de165b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:24.035764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:30:24.038196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:30:24.094384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-140217b7-ca11-48fb-83a9-e8e66c2b1c05 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494225 Aug 11 16:30:24.095580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 196/373] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:30:24.107387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-74439654-5a8e-4d6e-b10f-132459d4e0da tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.108878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-74439654-5a8e-4d6e-b10f-132459d4e0da tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.173212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-74439654-5a8e-4d6e-b10f-132459d4e0da tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.180484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-74439654-5a8e-4d6e-b10f-132459d4e0da tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1214 microversion: 2.1 time: 0.077387 Aug 11 16:30:24.181058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 197/374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:24.186089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.186720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.201684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.202835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.203455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.204509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.205256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.205570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.217587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.228265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a8f386f6-f717-49b7-9fbe-5283d00ed2c7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.317199 Aug 11 16:30:24.229249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 178/375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:23 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:24.257427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.258050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.277945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.278445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.278882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.279592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.280047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.280500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.533412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.556044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d97fd183-e051-47d0-b030-a0b3c180e698 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.325678 Aug 11 16:30:24.559358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 179/376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:24.565251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.567113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.589101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.589888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.590478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.591463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.593228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.593889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.668658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.678157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.679676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.680888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2f708aa0-e396-4230-bde7-a1cf44b2be31 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.498330 Aug 11 16:30:24.681711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 198/377] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:24.771449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.772056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.777972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.778447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.778874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.779555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.780009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.780451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.842252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.846570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:24.851861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-faaede41-dce2-4af9-b8f9-49efa396beb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1297 microversion: 2.1 time: 0.084741 Aug 11 16:30:24.852666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 199/378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:24.860024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-86256d61-39e8-44e7-9651-e99096828f81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1722 microversion: 2.1 time: 0.299415 Aug 11 16:30:24.860961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 180/379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:24.918961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:24.919545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:24.925919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.926427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.926983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:24.927730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:24.928288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:24.928719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.068578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.077160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4e0ffbff-b091-4150-9fcd-41dbb611f8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.162127 Aug 11 16:30:25.078050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 200/380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:24 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:25.201598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.202226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.209399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.211057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.212227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.213182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.214080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.214671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.249217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.250192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.257088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.257651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.258152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.258921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.259441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.259956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.299025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.309233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0de80108-4bfa-4c39-9143-62389b07d36e tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1218 microversion: 2.1 time: 0.111578 Aug 11 16:30:25.309838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 181/381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:25.405964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.414797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b988442-e723-49cb-b106-41c413a84d4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1502 microversion: 2.1 time: 0.169410 Aug 11 16:30:25.415377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 201/382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:25.435841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60d0b042-0ab9-477a-ad2f-9c7299a239ae"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:25.438525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.445339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.445800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.446239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.447022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.447623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.448053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.473429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Cannot 'attach_volume' instance aad28131-4298-4448-bdb8-74313c3bf525 while it is in vm_state rescued Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/os-volume_attachments HTTP/1.1 Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 74 Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:30:25.475289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {"volumeAttachment": {"volumeId": "60d0b042-0ab9-477a-ad2f-9c7299a239ae"}} Aug 11 16:30:25.476737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Cannot 'attach_volume' instance aad28131-4298-4448-bdb8-74313c3bf525 while it is in vm_state rescued Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': 'aad28131-4298-4448-bdb8-74313c3bf525', 'body': {'volumeAttachment': {'volumeId': '60d0b042-0ab9-477a-ad2f-9c7299a239ae'}}} Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aad28131-4298-4448-bdb8-74313c3bf525 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:30:25.477451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aad28131-4298-4448-bdb8-74313c3bf525 while it is in vm_state rescued Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:30:25.478677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aad28131-4298-4448-bdb8-74313c3bf525 while it is in vm_state rescued Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 409 to user: Cannot 'attach_volume' instance aad28131-4298-4448-bdb8-74313c3bf525 while it is in vm_state rescued {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1d2e8ed8-78fd-4aa4-a6fc-6d42d856ac04 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045155 Aug 11 16:30:25.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 182/383] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:30:25 2022] POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 11 16:30:25.492613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:25.492613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.498822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.499314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.499746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.500498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.500945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.501360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.577641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6e14e6a-904d-4522-88e5-f63f35f5aa63 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/action" status: 202 len: 0 microversion: 2.1 time: 0.092090 Aug 11 16:30:25.578566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 202/384] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:30:25 2022] POST /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:30:25.585370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.585968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.588455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.589168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.597504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.600772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.600957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.601541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.602708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.603257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.604044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.604598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.605145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.608653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.609342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.609928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.755861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.763994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-53d98b07-b180-4c8b-b3c8-e4cbeea4643b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1510 microversion: 2.1 time: 0.181263 Aug 11 16:30:25.764625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 203/385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:25.769492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.770277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.776342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.777007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.777634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.778495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.778955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.779382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.827416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.829849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:25.837261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d702f4bb-559a-4ff7-941e-2e7454bbd222 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.259193 Aug 11 16:30:25.843012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 183/386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:25.873679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.874407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.881569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.882054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.882482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.883172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.883613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.884292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.922686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.932672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.934218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:25.935665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-efe09281-c6cc-456c-a099-df3da4d91cd7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.169934 Aug 11 16:30:25.936548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 204/387] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:25.942084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:25.942705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:25.949383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.949865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.950639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:25.951787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:25.952491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:25.953113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.102601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.113459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ac49c2a-83fc-4b13-a402-fc9e632928de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1699 microversion: 2.1 time: 0.175861 Aug 11 16:30:26.114184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 205/388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:26.119153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.120068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.136560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.139321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.140426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.141596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.142274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.142918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.291361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.299470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-745e6b88-b9a8-4bee-808c-06edf6964e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.183988 Aug 11 16:30:26.300804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 206/389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:26.306667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:26.308754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:26.314684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.315284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.315916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.339837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Going to try to start instance {{(pid=120731) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 16:30:26.344528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.355377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5320168d-530f-4b74-9577-a32886995fb1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.485371 Aug 11 16:30:26.355955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 184/390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:25 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:26.369034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.369874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.376247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.377121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.377690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.378872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.379345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.379792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.388682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ece1021f-c233-485e-b4c1-8d62da18cd81 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action" status: 202 len: 0 microversion: 2.1 time: 0.086379 Aug 11 16:30:26.392324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 207/391] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:30:26 2022] POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:30:26.398700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.399567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.406038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.406597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.407185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.408079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.408622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.409110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.551558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.566349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aaad8459-04bb-48b6-afdd-85fe18008958 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1266 microversion: 2.1 time: 0.203585 Aug 11 16:30:26.567535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 185/392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:26.576238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.583485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8bae1e80-a68a-436d-bc90-3d9d7dfb7204 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1708 microversion: 2.1 time: 0.189306 Aug 11 16:30:26.584655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 208/393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1708 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:26.681911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9cb78-1668-4acc-8888-5ca1cd89b8cb", "tag": "04969a4e-488b-444f-ba97-7557cada5aa6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:26.693718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.694473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.695218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.716765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] Creating event network-changed:04969a4e-488b-444f-ba97-7557cada5aa6 for instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb on hv-cinder-85220 Aug 11 16:30:26.723259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-87542866-8d2a-41bf-b8de-c6c37db42408 req-794bf97d-541e-4b60-b508-45111dac264f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049000 Aug 11 16:30:26.724614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 186/394] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:26.785966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.786704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.793270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.793755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.794188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.794883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.795337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.795764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.858688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.859780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.862100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:26.869791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.870408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.871121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.872000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.872638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.873222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.945641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:26.953622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-226753da-b9d6-49b0-9c21-109ab9feb916 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1510 microversion: 2.1 time: 0.172142 Aug 11 16:30:26.954604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 209/395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:26.959861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:26.960495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:26.966942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.967432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.967866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:26.968589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:26.969073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:26.969496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.107380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.117066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.118523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.119708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa545dcf-e52d-42c2-ba88-ccd32ba5a261 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.163887 Aug 11 16:30:27.120475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 210/396] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:27.321534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:27.322150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:27.328134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.328729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.329344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.330055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.330512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.330936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.350625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:27.467061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.475815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d71690e5-68de-4e89-8f9f-393125125d22 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.158195 Aug 11 16:30:27.476422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 211/397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:27 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:27.481035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:27.481640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:27.488293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.489047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.489757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.490505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.491124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.492035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.629708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.639652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7d47cde8-de1c-4f29-aa04-61bc0ede4f7f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.162212 Aug 11 16:30:27.640275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 212/398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:27 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:27.645449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:27.646000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:27.652907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.653446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.653888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.654588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.655086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.655471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.719393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.726953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec6332f0-3c53-4b9c-be5f-0da79ffd0591 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1272 microversion: 2.1 time: 0.085703 Aug 11 16:30:27.727530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 213/399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:27 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:27.731941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:27.732570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:27.739522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.739522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.739874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.740660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.741027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.741452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.791965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.801785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-97cb8c73-4fa2-4288-bbfc-d938b938ab18 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.947408 Aug 11 16:30:27.802641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 187/400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:26 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:27.880703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:27.888681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60875259-2af8-4a0b-bd53-2cb18c1a8ab0 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1708 microversion: 2.1 time: 0.160189 Aug 11 16:30:27.889246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 214/401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:27 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:27.975895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:27.976807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:27.983055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.983577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.984019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:27.984783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:27.985238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:27.985666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.142886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:28.143890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:28.150248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.151458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.152428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.153834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.154989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.156158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.318771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.330705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.333465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.340896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c4797b4-792d-4fdc-a2aa-71f604e85f6d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.202081 Aug 11 16:30:28.341966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 215/402] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:28.497274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:28.498042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:28.505353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.505835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.506263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.506961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.507406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.507846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.564604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.575395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a54ca766-ec20-48b9-8f01-fd7bba1a0163 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1510 microversion: 2.1 time: 0.604116 Aug 11 16:30:28.576073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 188/403] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:27 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:28.668079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:28.669109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:28.671845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.680580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.682336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.682851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ee15824-0d22-47fc-8c34-8003fe7f98f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.189455 Aug 11 16:30:28.683304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.683765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 216/404] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:28 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:28.684844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.685708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.686366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.748644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:28.749709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:28.757927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.758548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.758985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.759700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.760176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.760606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.831706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:28.842096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b22a049-971f-4da2-9e8b-903ba5364e3f tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1272 microversion: 2.1 time: 0.097410 Aug 11 16:30:28.844640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 217/405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:28 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:28.849946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5283c193-adba-4892-a6a7-9f9db4233735", "tag": "002906ac-8f8d-418d-8e06-4d7973b553dd"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:28.863062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.863600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.864033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.879441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] Creating event network-changed:002906ac-8f8d-418d-8e06-4d7973b553dd for instance 5283c193-adba-4892-a6a7-9f9db4233735 on hv-cinder-85220 Aug 11 16:30:28.886479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-fc67d01e-cf22-44fc-9229-c4aef5329868 req-c3cd07bb-436d-4883-9d6c-90db5870dbd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041724 Aug 11 16:30:28.887386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 218/406] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:28.892734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:28.894257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:28.901538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.902030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.902517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:28.903229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:28.903694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:28.904271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.009830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.017736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e293521f-7389-4ffd-adf0-cdf5ebedacf3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.356921 Aug 11 16:30:29.019343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 189/407] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:28 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:29.024626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:29.025310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:29.033754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.037352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.037352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.038833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.039664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.040428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.055565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.064212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e565ad0-edc2-46fb-98a9-cfe308860ede tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.175601 Aug 11 16:30:29.064853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 219/408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:29.365757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:29.366523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:29.372791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.373273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.373705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.374411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.374857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.375274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.480048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.488213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b39c09e1-b5b2-4e0b-8f06-26e900cf791d tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1708 microversion: 2.1 time: 0.467505 Aug 11 16:30:29.489072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 190/409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:29 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1708 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:29.514481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.523307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.524766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.525913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4419923f-5188-411b-a14e-0741366488ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.164801 Aug 11 16:30:29.526472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 220/410] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:29.601220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:29.601851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:29.614267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.615163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.616036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.617187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.618040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.618634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.705246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:29.706209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:29.718796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.719314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.719729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.720553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.721010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.721435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.798132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.808725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-69cd9db8-214f-48ee-919b-1c5d27c99422 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1510 microversion: 2.1 time: 0.214838 Aug 11 16:30:29.810678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 191/411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:29 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:29.866788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:29.867661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:29.875212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.875696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.876249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.877099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:29.877549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:29.878186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:29.904405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:29.912912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed2e2047-1337-42ba-88e1-47b080dca351 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.213660 Aug 11 16:30:29.913493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 221/412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:29 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:30.015984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.024573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a56eda41-d2db-4c9f-a1fd-0d6b1771c370 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.163006 Aug 11 16:30:30.025236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 192/413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:29 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:30.038956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.039801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.046458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.046945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.047375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.048063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.048564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.048980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.089088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.089722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.099268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.099989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.100600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.101654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.102373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.102978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.207912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.220860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a939bf7b-f40a-480a-8f5d-4f8d3b682114 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.185765 Aug 11 16:30:30.222218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 222/414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:30.274433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.285520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5330fcaf-70a3-4c8c-aec3-6f6b1d7fef15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.200681 Aug 11 16:30:30.288691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e2fbc-243f-414d-a640-f814f64e7947", "name": "network-vif-plugged", "status": "completed", "tag": "5a8308f7-463f-4fc0-b4bb-809bb832b03f"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:30.298998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 193/415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:30.303125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.303884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.304981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.319828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] Creating event network-vif-plugged:5a8308f7-463f-4fc0-b4bb-809bb832b03f for instance b79e2fbc-243f-414d-a640-f814f64e7947 on hv-cinder-85220 Aug 11 16:30:30.325925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-3010e729-67e3-4c50-b3b7-e4571947a5fe req-2c58d970-488e-41b6-b5fe-468d4df777c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042007 Aug 11 16:30:30.327236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 223/416] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:30:30.509437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.510154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.516707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.517275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.517799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.519143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.519664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.520266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.549938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.550607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.557867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.558352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.558789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.559471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.559916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.560464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.659652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.668407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-413c6f1b-7e41-443e-97ce-6fbf31b0b1f6 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1708 microversion: 2.1 time: 0.162829 Aug 11 16:30:30.668977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 194/417] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:30.714246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.722399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.724174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:30.725333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4e1b77b2-9b63-4b9d-b541-64d7acabe655 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.179755 Aug 11 16:30:30.726005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 224/418] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:30.834022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.834896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.841318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.842122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.843904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.844926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.845626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.846054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.939330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:30.939922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:30.957296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.957764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.958313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:30.959127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:30.959849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:30.960472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.119401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.130312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f2e11370-b52c-4c6f-9f6f-9725e7f248c0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.200176 Aug 11 16:30:31.131507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 225/419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:31.136553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:31.137335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:31.148484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.148979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.149417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.150159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.150644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.151064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.174033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.184793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-188f51c5-9d7e-456b-808b-b05a48f1b488 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1516 microversion: 2.1 time: 0.356337 Aug 11 16:30:31.185992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 195/420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:30 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:31.243916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:31.245485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:31.262888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.263583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.264200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.265079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.265895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.266487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.333870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=4 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:31.344600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.355670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=14 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:31.356989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b0700ae-54ac-4453-90c7-481647ecdfac tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.220908 Aug 11 16:30:31.361994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 226/421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:31 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:31.370964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:31.371968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:31.384470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.387184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.387932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.389966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.392289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.392892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.606247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.633694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92968cbe-0c87-47ae-8de5-365d7592244c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.270256 Aug 11 16:30:31.647585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 227/422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:31.673439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.690992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:31.692042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:31.702264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fa8e2d76-8734-417f-ab8b-3996fa704405 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.461179 Aug 11 16:30:31.716134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 196/423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:31 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:31.716368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.716368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.716368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.716368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.716729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.716729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.749235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:31.750149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:31.761821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.762579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.763007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.763874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:31.764581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:31.765152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:31.884407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:31.893704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ee9ca8c-79dc-4c63-a8d5-a80f4bc936a3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1708 microversion: 2.1 time: 0.207808 Aug 11 16:30:31.894634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 228/424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:31 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1708 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:32.151147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:32.151902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:32.161545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.162177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.162873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.163771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.164298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.164728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.186778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:32.220277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.231652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.233187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.234887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0110d16d-32ec-420d-9d6d-1abedbf4c5e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.490554 Aug 11 16:30:32.250495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 197/425] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:32.324466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.335139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5c5729a-cecd-4a1b-a435-58b543a3c1a5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.188094 Aug 11 16:30:32.336407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 229/426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:32 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:32.348062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30563280-007b-44e4-9f49-983e9402588b", "tag": "222873e9-d4a8-4bff-81c8-d5aaeeebc652"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:32.362658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.363688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.364168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.378601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] Creating event network-changed:222873e9-d4a8-4bff-81c8-d5aaeeebc652 for instance 30563280-007b-44e4-9f49-983e9402588b on hv-cinder-85220 Aug 11 16:30:32.386634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-2f35a865-0263-46cd-9895-f17d753fe027 req-4f0a6ab2-82bf-4e15-8daf-3d1ea688be5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039827 Aug 11 16:30:32.386634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 198/427] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:32.386878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:32.387721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:32.396283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.396796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.397538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.398340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.398861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.399292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.533974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.542269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f225e1e-1acd-4bf1-b82a-f64f4123d8dc tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.162752 Aug 11 16:30:32.542929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 230/428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:32 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:32.655474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:32.656140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:32.662517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.662989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.663424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.664118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.664570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.664987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.731431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:32.732049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:32.739078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.739564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.739990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.741970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.742432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.742889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.914953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.915137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:32.923325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34445098-0da1-4009-be7a-9fda82cb7046 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.198364 Aug 11 16:30:32.923913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 231/429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:32 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:32.928296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0c907f12-a6e7-4856-9fef-4602657fed1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1264 microversion: 2.1 time: 0.277029 Aug 11 16:30:32.929090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 199/430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:32.934082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:32.934857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:32.941925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.942825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.943484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.944350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-045dd484-512b-4554-afae-61606668b08a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: .version_select at 0x7f614803b1f0>, body: {"keypair": {"name": "tempest-keypair-838272877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT8g1sbfdw9zqVXvaQhanfCGJKDbBtgih3ZcFIf7ky95Fu1wncPkwqCGznt89EkAceESL8BCkgkf9qzVaE9qyUuytFau/qysh3AgTe633reK0LMXRGJ3vNap0rre9d8OA=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:32.944485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:32.944932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:32.945361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:32.963142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-045dd484-512b-4554-afae-61606668b08a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:32.967550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-045dd484-512b-4554-afae-61606668b08a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for user 5d59680b3fde47bf81c7765ca4d8a757 and project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:32.994308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-045dd484-512b-4554-afae-61606668b08a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065233 Aug 11 16:30:32.994911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 232/431] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:30:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:33.097792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.107160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a7b3a05b-3125-4a35-8505-6c526fa730d2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1712 microversion: 2.1 time: 0.176893 Aug 11 16:30:33.107960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 200/432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:32 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1712 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:33.260366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:33.260975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:33.270540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.271003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.271451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.272609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.272722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.273268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.363550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:33.364306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:33.380815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.381308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.381738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.382432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.382895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.383894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.444788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.455019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.457520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.459653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00365543-0156-4d93-97bb-fcf004a20659 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1724 microversion: 2.20 time: 0.204569 Aug 11 16:30:33.460245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 233/433] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:33.563152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:33.563751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:33.570429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.570911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.571337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.572030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.572728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.573146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.741091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.749967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92ab2466-6cfc-4cde-a2dc-b60edff98ba8 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.190627 Aug 11 16:30:33.752149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 234/434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:33 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:33.809786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:33.812336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:33.819893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a4019769-bd10-4ba9-81bf-c59777568df8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.464827 Aug 11 16:30:33.821168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 201/435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:33 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:33.947914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:33.948553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:33.951044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:33.952697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:33.958602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.959195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.959514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.960240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.960686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.961099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.968186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.968935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.969527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:33.970402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:33.970995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:33.971609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.005121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:34.260875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:34.276857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e983ad59-ed15-4f99-8c84-8a3351e8b280 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.332641 Aug 11 16:30:34.278153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 235/436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:33 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:34.484423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:34.485898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:34.497805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.498951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.499474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.500964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.501608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.511530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.603518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:34.621342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e02db3d-f627-48c9-b5ef-2e69f3bfbe54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1451 microversion: 2.1 time: 0.674618 Aug 11 16:30:34.622169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 202/437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:33 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1451 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:34.645335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:34.646951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:34.655347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.656339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.657089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.658610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.659569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.660847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.786054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:34.798025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:34.799364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:34.813015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-410de475-0f32-475a-b932-7fd9309cb03d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1745 microversion: 2.20 time: 0.333608 Aug 11 16:30:34.820818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 236/438] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1745 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:34.820818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:34.820818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:34.835119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.835608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.836051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:34.842936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:34.843425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:34.844050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.015740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:35.028504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ffe444e3-62a1-423e-acb7-e665365f0d9f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1451 microversion: 2.1 time: 0.387176 Aug 11 16:30:35.040228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 203/439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:34 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1451 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:35.040228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:35.040228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:35.045512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.046328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.047181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.048150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.049342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.050688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.145250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:35.156509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-519b0610-0c0e-4b68-a848-29169e6736f2 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.341419 Aug 11 16:30:35.157087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 237/440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:34 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:35.305698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:35.307269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:35.322786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.323361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.324076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.324853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.325311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.325770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.386419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:35.400964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-655a08b1-6c0e-426d-9cb4-9d1f1b83bb98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.370124 Aug 11 16:30:35.401542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 204/441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:35 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:35.422497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-70316409", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b75ec96a-f925-4d74-8dce-3e38b63dd050"}], "security_groups": [{"name": "tempest-securitygroup--1251931710"}], "key_name": "tempest-keypair-838272877", "user_data": "}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:35.567859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:35.574231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] validate_networks() for [('b75ec96a-f925-4d74-8dce-3e38b63dd050', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:30:35.576049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b24c05a6-8853-458d-aa77-8e13eae44c61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.281100 Aug 11 16:30:35.583960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 238/442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:35 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:35.839031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:35.839645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:35.845729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.846213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.847310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:35.848006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:35.848489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:35.848917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.033770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:30:36.034751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:30:36.035193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:30:36.035636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:30:36.036790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:30:36.046886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.047363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.047791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.051399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.052087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.052802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.073452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:30:36.077711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Getting quotas for user 5d59680b3fde47bf81c7765ca4d8a757 and project 0ea665a47e44438aa8c4a9e763c78fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:30:36.090456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:30:36.092767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:30:36.142299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.150805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eafd9f43-cc48-47f5-9723-237edc5ef18f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.735142 Aug 11 16:30:36.152515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 205/443] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:30:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:30:36.156277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.161782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.163067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-63d28797-0f15-42e9-9e7f-446f09778658 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1745 microversion: 2.20 time: 0.327938 Aug 11 16:30:36.164745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9f291844-8346-49ea-bd35-4d9c929ad2a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:36.165372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9f291844-8346-49ea-bd35-4d9c929ad2a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:36.169247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 239/444] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1745 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:36.182428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:36.183151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:36.202505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.203227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.204581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.205295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.206563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.207004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.277365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f291844-8346-49ea-bd35-4d9c929ad2a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.285717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9f291844-8346-49ea-bd35-4d9c929ad2a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1243 microversion: 2.1 time: 0.126580 Aug 11 16:30:36.289543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 206/445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1243 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:36.422789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:36.423882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:36.438246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.442735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.443195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.443985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.444511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.444937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.585568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.600995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0565e6bd-cbcd-4e9f-ae35-1580ee4bb008 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.423262 Aug 11 16:30:36.603911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 240/446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:36 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:36.616799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f9cb78-1668-4acc-8888-5ca1cd89b8cb", "name": "network-vif-plugged", "status": "completed", "tag": "04969a4e-488b-444f-ba97-7557cada5aa6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:36.646261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.646776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.647183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.670703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] Creating event network-vif-plugged:04969a4e-488b-444f-ba97-7557cada5aa6 for instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb on hv-cinder-85220 Aug 11 16:30:36.686834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-7e1e5e2a-a77a-42f7-a7f4-74819446264b req-9c09094d-353c-4720-98c6-2b4f9cc63ed0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080497 Aug 11 16:30:36.688064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 241/447] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:36.697522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:36.700227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:36.711575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.713622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.714542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.715502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:36.716499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:36.717171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:36.721053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.731342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-75e496a1-122a-4c4e-8d73-c0f6d495636a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.312771 Aug 11 16:30:36.732136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 207/448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:36 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:36.969307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:36.984651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bff16238-35ff-48d7-a05e-5d2946e12d77 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.294673 Aug 11 16:30:36.985245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 242/449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:36 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:37.188266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:37.189442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:37.196909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.197641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.200009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.201539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.202011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.202594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.308776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:37.309405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:37.322084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.322604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.323053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.323788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.324447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.324879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.372423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:37.383800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:37.385510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:37.386675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-84aa471d-053a-4b93-9787-30bdf7cb7e9d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1745 microversion: 2.20 time: 0.202416 Aug 11 16:30:37.387400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 208/450] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:37.477261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:37.485356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0b9b9377-b630-4143-8521-82edf2f74878 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1247 microversion: 2.1 time: 0.183293 Aug 11 16:30:37.496847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 243/451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1247 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:37.625269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:37.625893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:37.634348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.634839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.635286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.635993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.636476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.636904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.753647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:37.759248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:37.768865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.769360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.769796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.770570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:37.771157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:37.771578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:37.786961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:37.798448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-72ef7c07-8510-4d1a-aaac-1070f9c0d1e6 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.178786 Aug 11 16:30:37.801200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 209/452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:37 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:38.007038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:38.007647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:38.019834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.021125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.024601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.025099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.025835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.026313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.026735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.029778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef481ffa-efdb-42dd-8907-37ad29d92afd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.280539 Aug 11 16:30:38.030359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 244/453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:37 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:38.054255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79e2fbc-243f-414d-a640-f814f64e7947", "tag": "5a8308f7-463f-4fc0-b4bb-809bb832b03f"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:38.067883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.068874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.069456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.085391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] Creating event network-changed:5a8308f7-463f-4fc0-b4bb-809bb832b03f for instance b79e2fbc-243f-414d-a640-f814f64e7947 on hv-cinder-85220 Aug 11 16:30:38.090534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-fa2e911e-e6b6-4ed7-a3c9-db9ea5bf4308 req-8e3586dc-b2f4-443b-8b7f-f2c9349bb18e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044115 Aug 11 16:30:38.095630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 245/454] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:38.383876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.397369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cb557e06-0910-4e5f-9959-2308caaa3f1b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.394930 Aug 11 16:30:38.397953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 210/455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:38 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:38.415623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:38.416658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:38.423522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.424316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.425578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.426476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.426999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.427489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.509125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:38.510277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:38.520501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.521152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.521944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.522859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.523494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.524091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.601277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.613060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e2831870-3424-4e67-90f9-875521bef9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1295 microversion: 2.1 time: 0.109329 Aug 11 16:30:38.626896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 211/456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:38.650131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.668989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.672817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:38.674285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b9a54a2-d592-423c-89d6-356979533131 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.266027 Aug 11 16:30:38.675276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 246/457] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:38.829585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:38.832309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:38.848980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.851434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.852322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.853309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:38.853773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:38.854359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:38.999735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "name": "network-vif-plugged", "status": "completed", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:39.019433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.030716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.032254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.073478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] Creating event network-vif-plugged:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:30:39.082022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-3a137e84-0161-4103-afb8-ce919a980b74 req-b7d37cf8-8daa-4c44-9c14-75ad16686254 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086427 Aug 11 16:30:39.082635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 247/458] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:30:39.095736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:39.097280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:39.151007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.157351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.158689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.160145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.162043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.164874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.370554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:39.380539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-24485b22-409e-4fe3-a068-4f2bfc988bae tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.560596 Aug 11 16:30:39.381398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 212/459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:38 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:39.419302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:39.420660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:39.428878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:39.438594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.439844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5432d5d0-3cb7-4af7-8abf-108f59bb6080 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1319 microversion: 2.1 time: 0.355733 Aug 11 16:30:39.441115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.441983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.442925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.443582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.459878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 248/460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:39 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:39.464659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.638883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:39.639499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:39.651978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.652642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.654825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.657788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.658287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.658761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.699440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:39.751459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:39.759917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7159ffb0-bd4c-4974-9bb9-8763a7ab2c99 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.344415 Aug 11 16:30:39.778573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 213/461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:39 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:39.783607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:39.787610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:39.810811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.812907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.813574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.814511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:39.820310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:39.821130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:39.865337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:39.889478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d47c96f-9d51-4a2d-bccb-2f01926143fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1301 microversion: 2.1 time: 0.240418 Aug 11 16:30:39.904974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 249/462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1301 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:40.185569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:40.197296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:40.203063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:40.204530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3b49b6a8-1743-4e02-8a4a-42995b16266b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.424692 Aug 11 16:30:40.207175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 214/463] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:40.414794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:40.418064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:40.444456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.446959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.448479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:40.453996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.457887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.459820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:40.477811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:40.481630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:40.496673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.497412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.499236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:40.500234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.504276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.505102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:40.790821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:40.810539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-513e729d-6d3e-4c3f-8de7-5fc627c3ee84 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.406333 Aug 11 16:30:40.835039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 250/464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:40 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:40.844943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:40.845832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:40.853744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.854466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.855063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:40.855936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:40.856669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:40.857374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.070744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.079080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8af31e2f-e80b-4044-8e45-f82403c15c0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.242678 Aug 11 16:30:41.081974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 251/465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:40 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:41.088294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:41.089171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:41.094775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:41.096970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.097951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.098583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.099493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.100155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.100730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.183294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.193782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.197658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ba1aac2b-4fcb-4d67-a3e6-320d4a0a9912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1508 microversion: 2.1 time: 0.735030 Aug 11 16:30:41.198895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 215/466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:40 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1508 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:41.203778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c80124fa-3062-4d74-acd8-25adad94ae20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1301 microversion: 2.1 time: 0.120535 Aug 11 16:30:41.205598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 252/467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1301 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:41.228957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:41.229830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:41.236525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.237187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.237688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.238708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.239378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.239992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.587656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.605912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.609898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:41.616220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-56f224c2-93bc-4218-a3d2-015cea1ea19f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.391567 Aug 11 16:30:41.638586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 216/468] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:41.836308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:41.837498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:41.850661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.851411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.852012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:41.852985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:41.853622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:41.854214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.106449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.111110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:42.112008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:42.123394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-10d63322-cc72-4d2c-ac2b-e64f5953d1ab tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.290760 Aug 11 16:30:42.124878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 253/469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:41 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:42.129469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.136599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.137361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.138325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.139033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.139713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.229910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:42.230680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:42.243595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.244550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.244981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.245886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.246702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.247526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.557000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.570308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1cfd6952-2795-4a8e-881b-1f5752d732a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.344114 Aug 11 16:30:42.571766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 254/470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:42.650535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:42.652983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:42.685677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.695214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.696400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.697678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.698433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.699508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.849978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.873948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c78b4210-a235-4af8-994d-d6138f7d795f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.767722 Aug 11 16:30:42.884379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 217/471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:42 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:42.904352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5283c193-adba-4892-a6a7-9f9db4233735", "name": "network-vif-plugged", "status": "completed", "tag": "002906ac-8f8d-418d-8e06-4d7973b553dd"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:42.935626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:42.936524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:42.937173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:42.961293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] Creating event network-vif-plugged:002906ac-8f8d-418d-8e06-4d7973b553dd for instance 5283c193-adba-4892-a6a7-9f9db4233735 on hv-cinder-85220 Aug 11 16:30:42.965853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.969023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-21d5fe55-b1b9-4128-9a36-46e3ed7f23b1 req-05f1ccf0-dc39-4318-86b8-26d69728d56b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075511 Aug 11 16:30:42.969939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 218/472] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:42.977331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.979133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:42.980397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-174a7b75-f4db-4b14-96e6-091a369c1e99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.336004 Aug 11 16:30:42.980959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 255/473] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:43.147707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:43.148507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:43.161972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.162469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.162898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.169246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:43.178587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.179383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:43.180439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.182036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.207916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.208935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.215306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.245217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] Creating event network-changed:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 16:30:43.261985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-d33df344-b8a8-49b6-b8bc-fa9b5dbcd2c0 req-8379a53b-6e12-45fa-aace-3beb32c2d0c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095681 Aug 11 16:30:43.264543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 256/474] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:43.602939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:43.603744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:43.610603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.611334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.612750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.613713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.614257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.614929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.623637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:43.638035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-04d7d9ce-c8b6-46ee-958b-988b7d6969ef tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.495809 Aug 11 16:30:43.641214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 219/475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:43 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:43.802536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:43.810747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec8b6d7e-77cb-4a14-b31e-66a522149d6b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.213337 Aug 11 16:30:43.813848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 257/476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:43.896481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:43.897732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:43.904285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.905485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.905938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:43.906628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:43.907234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:43.907817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.017266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:44.022819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:44.037695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.040845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.041527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.042515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.043124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.043704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.173178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:44.176323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:44.222985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:44.224455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0b56070a-39a1-4ad7-8cec-f1c5c5d81289 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.325336 Aug 11 16:30:44.225699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 220/477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:43 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:44.233662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:44.235170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:44.236402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-78bcae6f-ae08-4199-babe-2724dfe05284 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.226696 Aug 11 16:30:44.237025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 258/478] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:44.666667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:44.667268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:44.674158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.675462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.676257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.677067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.677725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.678375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.834010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:44.835153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:44.842272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.842568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.843073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.843857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:44.844414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:44.845032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:44.847833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:44.859223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-46c31ee9-60a4-4362-9ef1-2d84e8bfebc7 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.195082 Aug 11 16:30:44.859223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 221/479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:44 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:44.991746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30563280-007b-44e4-9f49-983e9402588b", "name": "network-vif-plugged", "status": "completed", "tag": "222873e9-d4a8-4bff-81c8-d5aaeeebc652"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:45.003856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:45.008607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.009336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.009766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.018801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d59bf50-611a-4881-b01b-e257a93e8b9f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.188772 Aug 11 16:30:45.022919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] Creating event network-vif-plugged:222873e9-d4a8-4bff-81c8-d5aaeeebc652 for instance 30563280-007b-44e4-9f49-983e9402588b on hv-cinder-85220 Aug 11 16:30:45.028766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-74050ac0-c69b-42bb-b743-768bde1cbddb req-13c8d639-4999-49c1-9f54-70417cf64d6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041576 Aug 11 16:30:45.029630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 222/480] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:30:45.033251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 259/481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:45.245544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:45.246487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:45.254277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.255032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.255711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.256661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.257268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.257992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.267475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:45.269967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:45.278250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.279202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.279863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.280831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.281668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.282313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.445289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:45.461160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-537d5041-eac2-4355-a6aa-ea5a9dd510f7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.219841 Aug 11 16:30:45.462328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:45.466828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 223/482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:45 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:45.485432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:45.488062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:45.489480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1895a783-294a-4e20-85be-0789768cee19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.226042 Aug 11 16:30:45.490047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 260/483] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:45.882426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:45.883048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:45.889530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.890012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.890584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:45.891289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:45.891744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:45.892219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.040844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:46.042063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:46.048411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.049180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.049638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.050355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.051407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.051992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.057826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.067333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:46.077252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-15ca9c59-fb92-4226-9962-fcd0046388e3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.199834 Aug 11 16:30:46.078264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 224/484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:45 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:46.226649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.234796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d78300a6-ba86-4963-83e4-abc3eb7627d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.197760 Aug 11 16:30:46.235370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 261/485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:46.488176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:46.490070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:46.492526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=8 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:46.503258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.503745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.504219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.504922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.509077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.517270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.528984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:46.531378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:46.548686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.553549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.555723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.558144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:46.560536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:46.561244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:46.759537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.770570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.774913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.775290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:46.776949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e29d5c2d-c55d-43d8-b3eb-eb7baa4bc0c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.263785 Aug 11 16:30:46.778110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 262/486] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:46.802684 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ad03e5b4-0ea5-4193-94bd-96f543d77076 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1365 microversion: 2.1 time: 0.319522 Aug 11 16:30:46.818234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 225/487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:46 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:47.099524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:47.100238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:47.106548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.107041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.107526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.108253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.108712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.109137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.256852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:47.258291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:47.265778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.266274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.266758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.267529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.268821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.269292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.320802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:47.341595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80f8290d-64dd-4347-8168-7b9b6b34b811 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.246329 Aug 11 16:30:47.356163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 263/488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:47 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:47.656207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:47.666356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-178e5577-dcd5-43cb-bdb0-ed2690353512 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.414188 Aug 11 16:30:47.667244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 226/489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:47.802108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:47.803008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:47.810598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.811085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.811520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.812244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.812865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.813453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.825649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:47.826258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:47.838215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.838705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.839142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.839851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:47.840344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:47.840911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:47.990275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:47.999634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:48.001325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:48.004157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68fb3bc9-2590-4986-9112-27b9a922d886 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.204779 Aug 11 16:30:48.004357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 264/490] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:48.029962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:48.071654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4c210ced-dd40-405c-a711-a5b4ec3a8be9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1556 microversion: 2.1 time: 0.217259 Aug 11 16:30:48.084175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 227/491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:47 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1556 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:48.094283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:48.094998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:48.102547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.103187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.103499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.104232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.104806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.105238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.193755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-769f381d-f502-43d8-a98b-ba9d56f23f4d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103243 Aug 11 16:30:48.194535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 265/492] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:30:48 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:48.368485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:48.369094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:48.371236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:48.383672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.386944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.387697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.394302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.397272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.397955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.688420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:48.689332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:48.704583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.705227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.705706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.706472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:48.707076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:48.707504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:48.728314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:48.737588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-196d555d-146d-4fec-afde-5b8a1276255b tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1314 microversion: 2.1 time: 0.372316 Aug 11 16:30:48.751328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 228/493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:48 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:48.972364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:48.976811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:48.985663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48737440-cb5e-4c2a-b85b-c1ae2d860fc9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.302364 Aug 11 16:30:48.986921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 266/494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:49.026653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:49.027271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:49.038976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:49.039502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:49.039927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:49.040830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:49.042136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:49.042760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:49.217871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:49.228019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:49.229764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:49.231802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5849ac4b-4f53-46bd-8dbe-ae31ce07adbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.208369 Aug 11 16:30:49.232534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 229/495] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:49.601559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5283c193-adba-4892-a6a7-9f9db4233735", "tag": "002906ac-8f8d-418d-8e06-4d7973b553dd"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:49.630983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:49.631371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:49.631804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:49.650601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] Creating event network-changed:002906ac-8f8d-418d-8e06-4d7973b553dd for instance 5283c193-adba-4892-a6a7-9f9db4233735 on hv-cinder-85220 Aug 11 16:30:49.657861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-8f984454-0018-4dc7-a8ff-bafa7b6109f7 req-c835ad32-0302-4556-b491-dcd07e2ec07a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061647 Aug 11 16:30:49.659522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 267/496] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:30:49.762123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:49.764251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:49.773663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:49.774318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:49.774768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:49.775474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:49.775993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:49.776467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:49.944036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:49.953779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e0c8647-fef0-400d-b45b-b28eb37bd6f3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1464 microversion: 2.1 time: 0.196821 Aug 11 16:30:49.955165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 230/497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:49 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:50.007048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:50.011686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:50.012680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:50.016373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:50.025087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.025587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.026694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.026870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.027178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.027667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.030695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.031480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.032131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.033036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.034269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.035301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.089936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:30:50.208086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:50.217662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3e8fdb9a-fa56-46f2-a5fd-33fa09660922 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.215011 Aug 11 16:30:50.219243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 231/498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:50.225838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fdb8f9b5-dc7a-4b49-a58b-20432e87b8a3 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 204 len: 0 microversion: 2.1 time: 0.224606 Aug 11 16:30:50.229845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 268/499] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:30:49 2022] DELETE /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:30:50.234734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:50.235354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:50.241959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.242447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.242882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.243598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.244034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.244494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.267041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:50.268664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:50.274868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.275359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.275792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.277009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:50.277009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:50.277365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:50.444489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:50.451316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:50.458103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2358b69e-4891-4f29-9496-ff20538ad098 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1470 microversion: 2.1 time: 0.227054 Aug 11 16:30:50.461495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:50.462886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 232/500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:50 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:50.463049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:50.464819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4cae471b-7df7-4647-abdb-ec387d6e5a3f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.208934 Aug 11 16:30:50.498228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 269/501] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:51.014260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "name": "network-vif-plugged", "status": "completed", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:51.042721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.043486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.044091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.070780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] Creating event network-vif-plugged:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 16:30:51.083159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-8dc38fab-90aa-4b57-bf29-cb7759c5f0b3 req-c5b35180-707f-4c43-8da0-1994e8a1f991 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072378 Aug 11 16:30:51.083667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 233/502] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:51.239298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:51.240015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:51.248231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.248746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.249541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.250437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.250890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.251312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.412638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:51.421298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9029400a-5c42-4666-a58f-0b0e46266f47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.186728 Aug 11 16:30:51.421969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 270/503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:51.491409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:51.492358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:51.500348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.501130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.501824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.503605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.504318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.504963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.505078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:51.505700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:51.511854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.512377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.512986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.513852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:51.514611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:51.515200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:51.668211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:51.677228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:51.678729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:51.678906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:51.679891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1a2bf3f-ab04-4db5-9cd7-d3a972c0a960 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.179318 Aug 11 16:30:51.688725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cdd21634-b943-449b-ae93-83583056d102 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1470 microversion: 2.1 time: 0.202056 Aug 11 16:30:51.693486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 234/504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:51 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:51.693636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 271/505] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:52.447443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:52.448073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:52.454417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.454891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.456040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.457024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.457639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.458171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.599647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:52.607208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d3f74500-1860-49a9-89cd-75c06594e0a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.163737 Aug 11 16:30:52.607772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 235/506] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:52.703590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:52.704135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:52.710311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:52.710974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:52.711712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.712223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.712663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.713354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.713810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.714231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.716885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.717364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.717800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.718490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:52.718943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:52.719370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:52.851366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:52.851784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:52.859356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:52.859860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b2c6d1a6-d00b-4155-a36e-e4fe77cba284 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1470 microversion: 2.1 time: 0.153450 Aug 11 16:30:52.860475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 236/507] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:52 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:52.860893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:52.863474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37d02729-a120-46ff-a94a-cafbb7f53e1a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1740 microversion: 2.20 time: 0.164445 Aug 11 16:30:52.864027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 272/508] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:53.629059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:53.629875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:53.636474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.637038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.637560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:53.638257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.638711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.639130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:53.884087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:53.884754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:53.905016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.907909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.908513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:53.910678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.911239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.911813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:53.967260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:53.975105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e525fde9-a6e1-4334-89ea-c2de7d8ba028 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.350381 Aug 11 16:30:53.975793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 237/509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:53.981926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:53.983608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:53.993729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.995595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.996343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:53.997944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:53.998498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:53.999157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:54.074750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:54.084411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dcb8fbc8-6afd-4c57-8fd5-5d46f1c419fd tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1470 microversion: 2.1 time: 0.206901 Aug 11 16:30:54.085191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 273/510] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:53 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:30:54.288272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30563280-007b-44e4-9f49-983e9402588b", "name": "network-vif-deleted", "tag": "222873e9-d4a8-4bff-81c8-d5aaeeebc652"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:54.288966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:54.291299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:54.297878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:54.298357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:54.299544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:54.300239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:54.301775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:54.303221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f6fa7e7-3bf7-4af5-89c1-c5a1a37b2496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1722 microversion: 2.20 time: 0.326251 Aug 11 16:30:54.308646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 238/511] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:54.311682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] Creating event network-vif-deleted:222873e9-d4a8-4bff-81c8-d5aaeeebc652 for instance 30563280-007b-44e4-9f49-983e9402588b on hv-cinder-85220 Aug 11 16:30:54.322353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-0aa2b4a4-bbb8-46cb-92ca-a346ac4859bd req-6964b39d-b7a0-4e40-9a56-8cc9d9fa0e64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037691 Aug 11 16:30:54.322960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 274/512] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:54.987206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "name": "network-vif-unplugged", "status": "completed", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:54.997816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:54.998046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:54.998703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.000293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:55.001232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:55.015327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] Creating event network-vif-unplugged:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:30:55.020993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.021482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-445ce5b5-8f9a-44e2-8498-474860c0fd38 req-6ca4d1bf-b16e-4d62-b2f8-ab2e6cc70e9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039434 Aug 11 16:30:55.021635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.022186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 239/513] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:55.023038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.023957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.024459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.025135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.106859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:55.108192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:55.115936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.116548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.116978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.117670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.118120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.118636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.150633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.151114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.151545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.151985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lazy-loading 'fault' on Instance uuid 30563280-007b-44e4-9f49-983e9402588b {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:30:55.176894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:55.184726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cee177b1-1696-4c38-9c7c-866cc7a8f0cd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1369 microversion: 2.1 time: 0.189893 Aug 11 16:30:55.185407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 275/514] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:55.196445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:55.204564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3a3343f0-858f-4003-a5da-1d710376d8b1 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1304 microversion: 2.1 time: 0.102610 Aug 11 16:30:55.205685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 240/515] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:55 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:55.328693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:55.329308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:55.336274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.336758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.337201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.337887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:55.338341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:55.338767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:55.494438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:55.503324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:55.504881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:55.506042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-be58dd9e-817e-4bd2-8dae-12fe569be0d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1722 microversion: 2.20 time: 0.181359 Aug 11 16:30:55.506605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 276/516] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:56.206913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:56.207432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:56.213928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.214403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.214830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.215510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.215951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.216405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.226266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:56.226869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:56.233426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.233900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.234324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.235006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.235451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.235862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.269407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.269892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.270322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.270762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lazy-loading 'fault' on Instance uuid 30563280-007b-44e4-9f49-983e9402588b {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:30:56.311512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:56.319118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85ce97df-c732-46ee-b002-fb1651736feb tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1304 microversion: 2.1 time: 0.096661 Aug 11 16:30:56.319683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 277/517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:56 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:56.347929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:56.355436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cbbb57de-1439-4918-ac67-ff4c2e8396e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1563 microversion: 2.1 time: 0.152451 Aug 11 16:30:56.355999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 241/518] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:56.375952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:56.376470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:56.382562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.383129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.383557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.384275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.384719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.385140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.465775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-54618e1d-50ca-4b46-9934-bdc28ac101e7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093753 Aug 11 16:30:56.466370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 278/519] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:30:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:56.529186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:56.529876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:56.536619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.537098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.537526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.538209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:56.538652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:56.539070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:56.676421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:56.684643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:56.686155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:56.687316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4355a78-cf9c-4515-9b9d-0ca8036a8266 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1722 microversion: 2.20 time: 0.162070 Aug 11 16:30:56.687878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 242/520] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:57.340477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:57.341141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:57.347436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.347921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.348391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.349090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.349546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.349971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.381866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.382350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.382790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.383241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lazy-loading 'fault' on Instance uuid 30563280-007b-44e4-9f49-983e9402588b {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:30:57.438035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7831d3847004751880cdda8d2e6ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0550e07d9e474e5485aa01188de165b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:57.446249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8adcf3c4-2b8b-4d1a-a762-bf43802d0362 tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 200 len: 1304 microversion: 2.1 time: 0.110186 Aug 11 16:30:57.446826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 279/521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:57 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:30:57.649984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:57.660648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.661115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.661539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.672329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] Creating event network-changed:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 16:30:57.685235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-c15bac7a-36b9-4c68-a7cf-78763ba9cb1e req-296c69f2-6fac-4ee2-b16d-c5a0b2ac9a89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038535 Aug 11 16:30:57.688534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 243/522] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:30:57.712072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:57.712728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:57.718971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.719459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.719896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.720652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:57.721703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:57.722550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:57.861215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:57.869970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:57.871481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:57.872695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa4d7fb2-606b-40d8-b5a0-1d0b74519507 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1722 microversion: 2.20 time: 0.165064 Aug 11 16:30:57.873249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 280/523] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:30:58.467317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:58.468015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] [instance: 30563280-007b-44e4-9f49-983e9402588b] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:58.475328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:58.475909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:58.476377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:58.477667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:58.478463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:58.479217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:58.497460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] HTTP exception thrown: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Request method failure captured: Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b HTTP/1.1 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S6dlvsaAfi95twpXgqO9nefoWft-MlEy-NLVbrDpDT3wE14qMXxMXOJoSqZvdbCuOaEosvQFJer2OedACUFXBbyMwRZPfMn06oZU1FO8v2hs-F3Bpw_NNW9VeUZ6wycLeZdfkp8BjVdoJi9JeDKrzjQXauFgTjIy5283Q32SQV1llw Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0550e07d9e474e5485aa01188de165b8 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesNegativeTest-667330930 Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:30:58.499111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0550e07d9e474e5485aa01188de165b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0550e07d9e474e5485aa01188de165b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0550e07d9e474e5485aa01188de165b8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0550e07d9e474e5485aa01188de165b8"}]}] Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesNegativeTest-667330930 Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0550e07d9e474e5485aa01188de165b8 Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesNegativeTest-667330930 Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesNegativeTest-667330930-project Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: b7831d3847004751880cdda8d2e6ef27 Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesNegativeTest-667330930-project Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. Aug 11 16:30:58.500634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '30563280-007b-44e4-9f49-983e9402588b'} Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:30:58.501399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. Aug 11 16:30:58.503230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:30:58.504318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] Returning 404 to user: Instance 30563280-007b-44e4-9f49-983e9402588b could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:30:58.504318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dd84330e-cef1-4e50-b033-07ca2d9ef5ff tempest-VolumesNegativeTest-667330930 tempest-VolumesNegativeTest-667330930-project] 10.222.0.43 "GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b" status: 404 len: 111 microversion: 2.1 time: 0.037509 Aug 11 16:30:58.507418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 244/524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:30:58 2022] GET /compute/v2.1/servers/30563280-007b-44e4-9f49-983e9402588b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:30:58.895731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:58.896943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:58.904598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:58.905321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:58.905971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:58.906894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:58.907561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:58.908043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.070012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.078935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.081640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.082481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3142c36e-e49a-4ffc-94d9-64f1c5a2e3ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1665 microversion: 2.20 time: 0.190823 Aug 11 16:30:59.083215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 281/525] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:30:59.108986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd5dab74-6c99-4e8a-8028-ce66ce69e580"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:59.111221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:59.123103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.124117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.124367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.125213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.125671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.126091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.478695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4c2af512-3bf0-4679-9f2b-fc8d1e62e2ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.374629 Aug 11 16:30:59.479210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 245/526] 10.222.0.43 () {62 vars in 1364 bytes} [Thu Aug 11 16:30:59 2022] POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 188 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:30:59.611762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:30:59.612484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:59.618777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.619253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.619680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.620393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.620836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.621257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.666866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120731) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 16:30:59.691556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:30:59.741738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-972d6f8f-82e5-4b42-85ea-45491d4efa41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action" status: 202 len: 0 microversion: 2.20 time: 0.134072 Aug 11 16:30:59.742351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 282/527] 10.222.0.43 () {62 vars in 1319 bytes} [Thu Aug 11 16:30:59 2022] POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:30:59.755211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:30:59.756013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:30:59.762620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.763104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.763538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.764283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:30:59.764734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:30:59.765363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:30:59.918299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.928937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.930964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:30:59.932668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-edd2008c-2d8b-4cf6-b59c-5f3d8bd41390 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1751 microversion: 2.20 time: 0.181586 Aug 11 16:30:59.933379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 246/528] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:30:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:00.956430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:00.957156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:00.963972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:00.964568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:00.965094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:00.966035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:00.966449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:00.967055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:01.117638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:01.126091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:01.128427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:01.129617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c5480b9b-0332-42e2-9556-e296a685a04f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1753 microversion: 2.20 time: 0.177788 Aug 11 16:31:01.130161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 283/529] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:02.152995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:02.153599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:02.159837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:02.160344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:02.160775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:02.161453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:02.161896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:02.162312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:02.290447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:02.298860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:02.300937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:02.302094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-01e2ffc4-cdcd-4ff2-b7a2-7b38fdb481e4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.153024 Aug 11 16:31:02.302649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 247/530] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:02.453289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a12448b7-30cf-4c01-84be-f062330bfd5a", "device": "/dev/sdb"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:02.458031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:02.464895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:02.465364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:02.465794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:02.466491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:02.467123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:02.467549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:02.765690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91150fdf-def7-4c5c-a389-556e6ce8f5a6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "POST /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318957 Aug 11 16:31:02.766285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 284/531] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:31:02 2022] POST /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:31:03.324620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:03.325234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:03.332032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:03.332595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:03.333039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:03.333730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:03.334184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:03.334605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:03.482015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:03.491770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:03.493279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:03.494569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ede4bd28-bb1e-4d1d-b372-cdfa0fb2635b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.173815 Aug 11 16:31:03.504301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 248/532] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:04.520272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:04.520877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:04.528086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:04.528599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:04.529029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:04.529970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:04.530293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:04.530711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:04.668421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:04.677867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:04.679769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:04.681196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9c4870d8-ecbc-4d39-80dc-9c36ee18b560 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.166653 Aug 11 16:31:04.682022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 285/533] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:31:05.706666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:05.707286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:05.714408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:05.714899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:05.715366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:05.716061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:05.716547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:05.716973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:05.854653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:05.863064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:05.864605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:05.865767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d7f14ba4-1f3e-42d9-8dda-2ef783cb6c36 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.164482 Aug 11 16:31:05.866325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 249/534] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:06.889033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:06.889627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:06.896912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:06.897396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:06.897831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:06.898516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:06.898975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:06.899400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:07.040302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:07.050648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:07.052211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:07.053726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d5bbc92a-23da-4c4a-a564-7e28584e1372 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.168549 Aug 11 16:31:07.054822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 286/535] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:08.082155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:08.083400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:08.090114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:08.090595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:08.091028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:08.091721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:08.092193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:08.092612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:08.242914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:08.251470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:08.253615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:08.254810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4baeaa5a-ca70-4db0-bfb2-b6a78d2e462d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.177037 Aug 11 16:31:08.255373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 250/536] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:09.280277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:09.282800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:09.297944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:09.298709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:09.299230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:09.300020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:09.300795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:09.301973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:09.467334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:09.477381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:09.478896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:09.480060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-860b30f9-4a57-44a4-a67e-42d33ddb211e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.204926 Aug 11 16:31:09.480647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 287/537] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:10.503406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:10.504309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:10.511710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:10.513867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:10.514359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:10.515092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:10.515549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:10.516002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:10.661294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:10.669889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:10.671578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:10.672806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7529a950-4211-4c69-a52a-8c5757e91ef7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.173875 Aug 11 16:31:10.673400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 251/538] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:11.697175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:11.697772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:11.700222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:11.706130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:11.706592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:11.707009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:11.707756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:11.708241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:11.708699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:11.846843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:11.855843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:11.857379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:11.858544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-edd420d1-e21f-4b0d-bb24-5fbc3895aa39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.165628 Aug 11 16:31:11.859101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 288/539] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:12.881220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:12.882905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:12.889412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:12.889902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:12.890337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:12.891039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:12.891484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:12.891903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:13.043091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:13.051555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:13.053099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:13.055055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e7f60ed-cc20-44cf-ac01-01b0f774bbed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.177771 Aug 11 16:31:13.055974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 252/540] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:14.079535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:14.081908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:14.090162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:14.090807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:14.091295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:14.092173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:14.092625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:14.093214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:14.240149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:14.249808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:14.251710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:14.252969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c02da85-17e0-41b7-8f78-52a534c08922 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.177936 Aug 11 16:31:14.253539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 289/541] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:15.277496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:15.278100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:15.284534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:15.285015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:15.285446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:15.286129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:15.286576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:15.286995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:15.433413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:15.446953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:15.448503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:15.449677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-371f4b03-e767-469f-8136-babc66e75b69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.177054 Aug 11 16:31:15.450306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 253/542] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:16.475764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:16.476366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:16.482922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:16.483407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:16.483845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:16.484587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:16.485044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:16.485494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:16.618882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:16.628023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:16.629566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:16.630738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06165bb6-5cba-49f8-be39-3b7ebf9cd4c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.158937 Aug 11 16:31:16.631303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 290/543] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:17.654260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:17.654868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:17.661368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:17.661845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:17.662276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:17.662959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:17.663411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:17.663889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:17.679547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:17.801982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:17.811318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:17.812860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:17.814016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9c963761-dcd2-41bc-af54-0635ca2c6f14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.163713 Aug 11 16:31:17.814564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 254/544] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:18.837553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:18.838264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:18.845003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:18.845507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:18.846127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:18.846826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:18.848550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:18.849019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:19.015508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:19.024919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:19.026440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:19.027621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7122d40e-c62a-4764-b748-e01af58750de tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.194794 Aug 11 16:31:19.028210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 291/545] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:20.051056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:20.051645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:20.054086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:20.059994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:20.060504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:20.060942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:20.061630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:20.062077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:20.062497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:20.193794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:20.202671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:20.204236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:20.205419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-24ea1c82-671c-41f5-9f87-f41469a80046 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.158242 Aug 11 16:31:20.205971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 255/546] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:21.229612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:21.230226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:21.236722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:21.237208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:21.237642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:21.238334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:21.238787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:21.239208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:21.369469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:21.377791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:21.379294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:21.380477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e641511-2931-42f8-a17e-f701b5c6a8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.155693 Aug 11 16:31:21.381031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 292/547] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:22.405317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:22.405898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:22.412239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:22.412717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:22.413145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:22.413829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:22.414409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:22.414843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:22.548351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:22.559686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:22.561389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:22.562557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-992d75e0-ee7a-4820-a6c0-a1961918c985 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.161091 Aug 11 16:31:22.563102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 256/548] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:23.586719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:23.587335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:23.593879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:23.594298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:23.594735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:23.595423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:23.595875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:23.596329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:23.728425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:23.736894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:23.738406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:23.739557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1c16e58-aa39-4bca-9692-06ea49cd265a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.157511 Aug 11 16:31:23.740119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 293/549] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:24.762716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:24.763257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:24.769630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:24.770105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:24.770535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:24.771207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:24.771651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:24.772067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:24.901216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:24.909621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:24.911129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:24.912316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c0f31a1d-febd-48f7-883b-6250e8c2a574 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.153701 Aug 11 16:31:24.912885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 257/550] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:25.936517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:25.937124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:25.943572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:25.944048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:25.944508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:25.945723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:25.946220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:25.946648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:26.076353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:26.084728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:26.086874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:26.088032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0d8bd011-cef4-4359-aa41-af445a990b96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.155395 Aug 11 16:31:26.088619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 294/551] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:31:26.806178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "name": "network-vif-plugged", "status": "completed", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:26.816601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:26.817071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:26.817499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:26.829197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] Creating event network-vif-plugged:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:31:26.834073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-b9834c41-8b73-425d-a833-bd6d999ac9fd req-08070860-c0ce-42cb-a6c3-e66908001a90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031597 Aug 11 16:31:26.834646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 258/552] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:31:27.111020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:27.111634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:27.118781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:27.119269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:27.119708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:27.120587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:27.121058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:27.121480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:27.252538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:27.261480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:27.263001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:27.264178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c89a2b0-8308-4613-909c-f837524b7d7f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.157147 Aug 11 16:31:27.264732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 295/553] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:28.287852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:28.288587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:28.295375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:28.295851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:28.296332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:28.297005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:28.297457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:28.297883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:28.426694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:28.435342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:28.436872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:28.438025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3662c744-f97a-4d06-a453-3fe8680ef22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.155035 Aug 11 16:31:28.438607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 259/554] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:29.461785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:29.462315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:29.468799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:29.469273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:29.469699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:29.470377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:29.470821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:29.471236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:29.601223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:29.609621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:29.611107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:29.612281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc3b1ce2-711d-449a-9ebb-c8e0dd1da5a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.155001 Aug 11 16:31:29.612834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 296/555] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:30.635618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:30.636241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:30.642779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:30.643252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:30.643682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:30.644385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:30.644830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:30.645246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:30.780959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:30.789667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:30.791177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:30.792367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3e176323-5cc0-40c6-b830-69ffaf52fa20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.160756 Aug 11 16:31:30.792917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 260/556] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:31.816226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:31.816952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:31.824267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:31.824760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:31.825195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:31.825887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:31.827237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:31.827670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:31.830809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:31.961453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:31.969865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:31.971380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:31.972678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9040ae4f-12bf-4ab9-af2f-26e2a7f8ee9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.160583 Aug 11 16:31:31.973235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 297/557] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:32.996632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:32.997324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:33.003924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:33.004437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:33.004869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:33.005550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:33.005996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:33.006416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:33.153777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:33.162398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:33.164756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:33.165627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff7c7c45-854f-45a5-bac8-4632f27b4c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1809 microversion: 2.20 time: 0.173296 Aug 11 16:31:33.166261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 261/558] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:31:34.188533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:34.189062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:34.196442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:34.196928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:34.197366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:34.198058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:34.198515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:34.198943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:34.334415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:34.343519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:34.345065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:34.346280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86616a9d-0187-48c7-af70-c4bf38f1995e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1796 microversion: 2.20 time: 0.161730 Aug 11 16:31:34.346838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 298/559] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:31:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:31:35.096633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:35.097122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:35.104178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:35.104655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:35.105087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:35.105766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:35.106212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:35.106630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:35.231051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid b9f9cb78-1668-4acc-8888-5ca1cd89b8cb {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:31:35.344552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-94f5e84f-33e8-4ca7-993f-7cb8263021eb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb/os-volume_attachments/a12448b7-30cf-4c01-84be-f062330bfd5a" status: 202 len: 0 microversion: 2.1 time: 0.251609 Aug 11 16:31:35.345289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 262/560] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:31:35 2022] DELETE /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb/os-volume_attachments/a12448b7-30cf-4c01-84be-f062330bfd5a => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:31:36.470907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:36.471472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:36.477979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:36.478475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:36.478907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:36.479599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:36.480047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:36.480502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:36.505024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:31:36.578518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e0b424f-c0c2-4fb7-8eb4-53aed3832e71 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 204 len: 0 microversion: 2.1 time: 0.111334 Aug 11 16:31:36.579154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 299/561] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:31:36 2022] DELETE /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:31:36.589117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:36.589817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:36.597337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:36.598024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:36.598475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:36.599265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:36.599721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:36.600177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:36.727411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:36.734866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-93b86bf5-0a7f-41e1-82e3-ff0c26e8551e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1514 microversion: 2.1 time: 0.151359 Aug 11 16:31:36.735431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 263/562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:36 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:37.756470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:37.757163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:37.764668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:37.765151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:37.765592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:37.766274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:37.766727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:37.767150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:37.895418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:37.902891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1100d5b0-7717-4568-9919-0aec6bc9463f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1514 microversion: 2.1 time: 0.150662 Aug 11 16:31:37.903463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 300/563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:37 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:38.924171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:38.924891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:38.932609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:38.933103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:38.933543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:38.934832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:38.935306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:38.935732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:39.169705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:39.177539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d6f93ae5-7c91-4019-b82f-762a4772a8b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 200 len: 1514 microversion: 2.1 time: 0.257185 Aug 11 16:31:39.178145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 264/564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:38 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:39.455540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f9cb78-1668-4acc-8888-5ca1cd89b8cb", "name": "network-vif-deleted", "tag": "04969a4e-488b-444f-ba97-7557cada5aa6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:39.469119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:39.469595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:39.470020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:39.483419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] Creating event network-vif-deleted:04969a4e-488b-444f-ba97-7557cada5aa6 for instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb on hv-cinder-85220 Aug 11 16:31:39.489269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-bd62d2bf-016f-494c-aef8-b99c62fefa8d req-00522c4e-d967-4be9-a172-a4b1d58e181d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037153 Aug 11 16:31:39.490048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 301/565] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:31:40.200157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:40.200694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: b9f9cb78-1668-4acc-8888-5ca1cd89b8cb] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:40.207067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:40.207551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:40.207986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:40.208699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:40.209155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:40.209581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:40.226698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] HTTP exception thrown: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Request method failure captured: Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb HTTP/1.1 Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S6Z-9KTwRt6RmjwUev7-nT77NIIhj-ZaWT7oOpyh5CDZjs2aguk-pjWc-IR8GUUvS0Tnf8ZqWfTosPIh7vJ5C8v9GBXGGAOcCh4_MseC9v4wFbM4TmOMV0aBI6xCL1WXhDOtxkOoOiHv1Qf7NdbCXzABpqdt8qcCOytrv8Rx8Nl9gQ Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:31:40.228635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92e71ba59c6d42dabeef49f62cebac1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}] Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 992a34be52b7491da0b68cbe17f25b39 Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. Aug 11 16:31:40.230230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'b9f9cb78-1668-4acc-8888-5ca1cd89b8cb'} Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:31:40.231152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. Aug 11 16:31:40.232732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:31:40.234010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Returning 404 to user: Instance b9f9cb78-1668-4acc-8888-5ca1cd89b8cb could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:31:40.234010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1b50d44f-2040-4946-bf05-61a0bf9c32a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb" status: 404 len: 111 microversion: 2.1 time: 0.034456 Aug 11 16:31:40.234010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 265/566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:40 2022] GET /compute/v2.1/servers/b9f9cb78-1668-4acc-8888-5ca1cd89b8cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:31:43.478433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:43.479087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:43.481833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:43.487772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:43.488306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:43.488783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:43.489626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:43.490216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:43.490689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:43.619642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lazy-loading 'services' on Instance uuid 7fca7c34-392f-431f-8ba3-191be7a54e10 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:31:43.730123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4700fe4d-d2a9-4c99-bd6b-5eff7d98aecb tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments/cc2f77f2-0622-4a7a-a20a-78d7283f3cfb" status: 202 len: 0 microversion: 2.1 time: 0.256202 Aug 11 16:31:43.730710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 302/567] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:31:43 2022] DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments/cc2f77f2-0622-4a7a-a20a-78d7283f3cfb => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 16:31:44.857068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:44.863898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:44.864404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:44.864834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:44.933856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Going to try to stop instance {{(pid=120730) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 16:31:44.973550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3286de00-4d0e-4ecd-abfd-025b2f0333d4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action" status: 202 len: 0 microversion: 2.1 time: 0.120327 Aug 11 16:31:44.974134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 266/568] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:31:44 2022] POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:31:44.983743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:44.984474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:44.991485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:44.992018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:44.992492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:44.993980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:44.994793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:44.995223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:45.130243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:45.138041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e190e01d-3090-4227-85d4-45fe7b2cf700 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.159023 Aug 11 16:31:45.138599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 303/569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:44 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:46.160452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:46.161156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:46.167914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:46.168424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:46.168861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:46.169550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:46.170002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:46.170428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:46.298277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:46.306202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-29e6a251-da6b-4f3d-a781-2131e3f330bf tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.149909 Aug 11 16:31:46.306751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 267/570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:46 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:47.327971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:47.328610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:47.335047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:47.335529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:47.335988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:47.336725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:47.337179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:47.337594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:47.473647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:47.482181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0473b1c5-652a-42c9-9252-c398d9ace8d7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.158103 Aug 11 16:31:47.482821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 304/571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:47 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:48.504627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:48.505258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:48.512214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:48.512693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:48.513124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:48.513807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:48.514250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:48.514665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:48.518658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:48.643952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:48.652463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3f4e3be2-8058-4866-8d0e-f15da56d2467 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.151634 Aug 11 16:31:48.653022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 268/572] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:48 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:49.098148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1536842183", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "networks": [{"uuid": "5c40a0da-265a-40a9-8468-1fae6995f12d"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:49.151184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] validate_networks() for [('5c40a0da-265a-40a9-8468-1fae6995f12d', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:31:49.503807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:31:49.504186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:31:49.504653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:31:49.505056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:31:49.505490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:31:49.514771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:49.515244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:49.515669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:49.516407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:49.516851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:49.517264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:49.533926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Getting quotas for project 92e71ba59c6d42dabeef49f62cebac1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:31:49.537758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Getting quotas for user 992a34be52b7491da0b68cbe17f25b39 and project 92e71ba59c6d42dabeef49f62cebac1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:31:49.548740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:31:49.550949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:31:49.595286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3df25be-2763-479f-b1f9-31341629baf3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501001 Aug 11 16:31:49.595919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 305/573] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:31:49.606938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eeff8d64-7b43-4e81-9b8b-8387e3e9dfc6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:49.607540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eeff8d64-7b43-4e81-9b8b-8387e3e9dfc6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:49.663933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eeff8d64-7b43-4e81-9b8b-8387e3e9dfc6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:49.670676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eeff8d64-7b43-4e81-9b8b-8387e3e9dfc6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1219 microversion: 2.1 time: 0.067687 Aug 11 16:31:49.671229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 269/574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:49 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:49.674232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:49.674909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:49.685831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:49.686311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:49.686749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:49.687441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:49.687888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:49.688497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:49.823333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:49.831936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34a09c76-4a26-4941-9aa8-302ca6896fb1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.161893 Aug 11 16:31:49.832042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 306/575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:49 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:50.692388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:50.693215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:50.697103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=32 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:50.701927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:50.702433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:50.702898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:50.703599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:50.704056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:50.704530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:50.822282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:50.829620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c71904d3-e426-4248-a8b7-42d09e87648a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1289 microversion: 2.1 time: 0.141137 Aug 11 16:31:50.830174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 270/576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1289 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:50.852218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:50.853008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:50.859436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:50.859915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:50.860370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:50.861087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:50.861532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:50.861949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:51.001970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:51.010091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0dc728eb-a704-4518-aff5-ee8aeaddee5f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.161797 Aug 11 16:31:51.010664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 307/577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:50 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:51.850781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:51.851385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:51.857780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:51.858256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:51.858685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:51.859375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:51.859835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:51.860281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:51.901350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984554e8-81f8-42e6-b2a5-3067ea1b1ad0", "tag": "734bce4d-4e8a-40aa-8c54-787cf874a86c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:51.917040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:51.918009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:51.918754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:51.934477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] Creating event network-changed:734bce4d-4e8a-40aa-8c54-787cf874a86c for instance 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 on hv-cinder-85220 Aug 11 16:31:51.940578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-da0228a0-2c38-491c-8265-c4bc9d6c14de req-fedae88e-d67a-4b5c-a4ce-426c34a9edbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044728 Aug 11 16:31:51.941172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 308/578] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:31:52.031351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:52.032175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:52.038258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:52.039053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:52.039174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:52.040583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:52.040583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:52.041543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:52.102072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:52.109618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c65b70ae-59f1-4357-8b52-726838b729ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.262637 Aug 11 16:31:52.110495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 271/579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:51 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:52.174289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:52.183441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6a7ce54-101f-4ba5-8ad0-b64c9c80241f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.156377 Aug 11 16:31:52.184128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 309/580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:52 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:53.130880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:53.131499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:53.137898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:53.138365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:53.138788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:53.139461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:53.139902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:53.140342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:53.204861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:53.205466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:53.212576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:53.213070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:53.213508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:53.214207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:53.214657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:53.215083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:53.269726 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:53.277732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5bf70d08-1be1-4c81-9d4d-7ba8ca57f3b4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.150731 Aug 11 16:31:53.278300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 272/581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:53.348767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:53.357055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-acea50de-5ebe-434c-bae1-5656ad783245 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.156091 Aug 11 16:31:53.357632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 310/582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:53 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:54.298810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:54.299420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:54.306244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:54.306724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:54.307473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:54.308127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:54.308583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:54.309004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:54.378169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:54.378798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:54.386068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:54.386552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:54.387074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:54.387771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:54.388251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:54.388672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:54.472659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:54.480316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-93d6353a-5a4e-41aa-bc78-a896accbad29 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.185320 Aug 11 16:31:54.480889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 273/583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:54.521856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:54.529822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4ab1316-afe2-411c-a81e-602c84c46e37 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.155493 Aug 11 16:31:54.530380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 311/584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:54 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:55.500594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:55.501184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:55.509616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:55.510109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:55.510551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:55.511431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:55.512010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:55.512491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:55.550477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:55.551331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:55.558875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:55.559367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:55.559805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:55.560542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:55.561189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:55.561616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:55.652271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:55.659693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d903c445-9411-4977-ae82-f5c0fe3e6cc9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.163238 Aug 11 16:31:55.660502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 274/585] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:55.700221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:55.708056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b1166028-0192-484e-91f7-6859e878ad2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.161400 Aug 11 16:31:55.708724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 312/586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:55 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:56.682492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:56.683089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:56.689555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:56.690034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:56.690466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:56.691149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:56.691599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:56.692023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:56.730055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:56.730683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:56.737242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:56.737721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:56.738152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:56.738839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:56.739287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:56.739705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:56.755169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:31:56.823821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:56.831428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-db57b740-0257-472b-930a-1e34335ee405 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.153668 Aug 11 16:31:56.832000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 275/587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:56 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:56.871123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:56.878579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d012b29a-362c-4336-89c0-32c9234e63dc tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.152830 Aug 11 16:31:56.879136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 313/588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:56 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:57.509383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984554e8-81f8-42e6-b2a5-3067ea1b1ad0", "name": "network-vif-plugged", "status": "completed", "tag": "734bce4d-4e8a-40aa-8c54-787cf874a86c"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:57.519471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.519971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.520574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.531685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] Creating event network-vif-plugged:734bce4d-4e8a-40aa-8c54-787cf874a86c for instance 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 on hv-cinder-85220 Aug 11 16:31:57.536674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-d545889a-51fe-41d5-852b-6d776140b7ce req-bf748a27-c2f7-4bd0-ac6f-7bec6d0abe99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030869 Aug 11 16:31:57.537183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 276/589] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:31:57.847881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:57.848460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:57.853096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:57.853801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:57.855599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.856085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.856808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.857234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.857685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.858161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.860622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.861102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.861537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.862222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.862672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.863097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.881263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c02cc957-2953-422b-b3e7-c7b73ea71320 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/ips" status: 200 len: 151 microversion: 2.1 time: 0.037199 Aug 11 16:31:57.881814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 314/590] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:31:57 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:31:57.893987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb194d16-400c-4811-8aac-a06b5d062531"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:31:57.896367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:57.902925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.903409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.903843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.904571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:57.905024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:57.905446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:57.991472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 Aug 11 16:31:57.993429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: POST /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/os-volume_attachments HTTP/1.1 Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 74 Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:31:57.993753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {"volumeAttachment": {"volumeId": "bb194d16-400c-4811-8aac-a06b5d062531"}} Aug 11 16:31:57.995293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '5283c193-adba-4892-a6a7-9f9db4233735', 'body': {'volumeAttachment': {'volumeId': 'bb194d16-400c-4811-8aac-a06b5d062531'}}} Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:31:57.996145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:31:57.997449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 400 to user: Invalid volume: volume bb194d16-400c-4811-8aac-a06b5d062531 is already attached to instances: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04d0310b-8322-439f-90df-efeb8e7b2c9a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105065 Aug 11 16:31:57.999692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 315/591] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:31:57 2022] POST /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 16:31:58.002819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-206b4a33-7414-4f61-9d93-9021d5e4afdb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.154980 Aug 11 16:31:58.002982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:58.003378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 277/592] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:58.003591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:58.007816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:58.008377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:58.010715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.011202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.011642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.012366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.012823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.013247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.014882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.015363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.015800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.016607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.017095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.017519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.045389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:31:58.124461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ec866eec-cd43-4a11-ad0a-b322877f35b5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 204 len: 0 microversion: 2.1 time: 0.119795 Aug 11 16:31:58.125056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 278/593] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:31:58 2022] DELETE /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:31:58.134429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:58.135342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:58.143194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.143678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.144232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.144964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:58.145411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:58.145838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:58.152884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:58.160458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72849c2d-2505-40c6-b906-d895e9221aa4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.162639 Aug 11 16:31:58.161016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 316/594] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:57 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:58.278302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:58.285642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1f793d7d-bf88-4888-85d0-b63a53f758be tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1681 microversion: 2.1 time: 0.155983 Aug 11 16:31:58.286207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 279/595] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:58 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:31:59.023395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:59.024669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:59.031027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.031509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.031940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.032660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.033114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.033535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.164915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:59.172224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b80ea9d-62e6-46f1-89a6-4f232554da55 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.152614 Aug 11 16:31:59.172785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 317/596] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:59.183181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:59.183971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:59.190061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.190541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.190971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.191653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.192120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.192539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.308276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:31:59.308999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:31:59.314998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.315552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.316058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.316836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:31:59.317381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:31:59.317878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:31:59.321438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:59.329002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1ff5eeb4-8333-4c0f-b797-194453727b08 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.150669 Aug 11 16:31:59.329582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 280/597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:59 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:31:59.450634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:31:59.458158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a4e19d7e-1101-4735-aad1-b126fde0d6c1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1681 microversion: 2.1 time: 0.155008 Aug 11 16:31:59.458532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 318/598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:31:59 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:00.193831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:00.194434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:00.196392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:00.201861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.202331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.202757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.203428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.203871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.204319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.333616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:00.341679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f206e468-5a0f-474b-bfb2-8c4cd307dd13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1319 microversion: 2.1 time: 0.151662 Aug 11 16:32:00.342247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 281/599] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:00.350211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:00.350819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:00.353274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:00.353919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:00.360610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.361088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.361514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.362235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.362680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.363120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.480688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:00.481291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:00.487055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.487533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.487960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.488664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:00.489106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:00.489521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:00.494769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:00.502252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-09246827-0317-4120-8bb1-22b5b53b101f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1676 microversion: 2.1 time: 0.155871 Aug 11 16:32:00.502821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 319/600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:00 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:00.616809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:00.624604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8d1c25ca-10eb-49cb-a027-12bcf6143700 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1681 microversion: 2.1 time: 0.147787 Aug 11 16:32:00.625174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 282/601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:00 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:01.362898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:01.363512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:01.370189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.370678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.371115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.371820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.372297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.372720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.512039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:01.520456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc3e3549-eb83-49d7-a6ed-23306a5a5354 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1508 microversion: 2.1 time: 0.161345 Aug 11 16:32:01.526644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:01.529563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:01.536736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 320/602] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:01.537752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.538415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.539139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.540388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.541201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.541927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.542155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "951a47cd-1ac0-4257-8e1d-c0fbf84a86f3", "device": "/dev/sdb"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:01.544873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:01.551253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.551937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.552566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.553422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.554022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.554592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.763928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:01.776849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-601de5b3-980e-4a9d-a189-5ca71cf8cf6b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1653 microversion: 2.1 time: 0.257700 Aug 11 16:32:01.792136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 283/603] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:01 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1653 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:01.792136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5283c193-adba-4892-a6a7-9f9db4233735", "name": "network-vif-deleted", "tag": "002906ac-8f8d-418d-8e06-4d7973b553dd"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:01.792976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.793701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.794404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.807777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] Creating event network-vif-deleted:002906ac-8f8d-418d-8e06-4d7973b553dd for instance 5283c193-adba-4892-a6a7-9f9db4233735 on hv-cinder-85220 Aug 11 16:32:01.813186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-afad00be-422c-434b-8f67-031d1933c968 req-d3a7de8a-7f9c-4335-b713-18b91252efe3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 Aug 11 16:32:01.813989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 284/604] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:01.819839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:01.820565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:01.828447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.828928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.829625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.830481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.831100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.831676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.851117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:01.872845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.873736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.874394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.875086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lazy-loading 'fault' on Instance uuid 5283c193-adba-4892-a6a7-9f9db4233735 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:32:01.923912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:01.926597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60b8861e-b5c7-4623-a025-dea629cdc935 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "POST /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388510 Aug 11 16:32:01.927208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 321/605] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:32:01 2022] POST /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:01.932758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-21aa250a-7fcc-4125-b1f6-fc96335a9333 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 200 len: 1329 microversion: 2.1 time: 0.117133 Aug 11 16:32:01.933327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 285/606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:01 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 1329 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:01.934315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:01.941082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:01.941674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:01.942162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:01.971796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Going to try to start instance {{(pid=120731) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 16:32:02.020634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7935a91a-e4c9-45d3-8573-716e6a9288ad tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action" status: 202 len: 0 microversion: 2.1 time: 0.091850 Aug 11 16:32:02.024666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 322/607] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:32:01 2022] POST /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:32:02.030680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:02.031577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:02.040563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:02.042278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:02.042738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:02.043940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:02.044589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:02.045168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:02.298326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:02.308708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-13ba0f39-c110-41ff-9c87-ab32d3b226d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1662 microversion: 2.1 time: 0.282592 Aug 11 16:32:02.323089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 286/608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:02 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1662 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:02.954614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:02.955602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:02.962128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:02.962538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:02.962979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:02.963674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:02.964157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:02.964610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:02.979060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 HTTP/1.1 Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:32:02.980735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:32:02.982217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '5283c193-adba-4892-a6a7-9f9db4233735'} Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:32:02.983016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:32:02.984228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:32:02.985269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:32:02.985269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e9c5d0fd-fd14-4086-b41b-df9b7ebe11c2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 404 len: 111 microversion: 2.1 time: 0.032259 Aug 11 16:32:02.985269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 323/609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:02 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:32:02.990930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd0c4745-fb64-45c6-81a5-55506a684dc5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '.version_select at 0x7f6143ea6700>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:03.028182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dd0c4745-fb64-45c6-81a5-55506a684dc5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91804665" status: 202 len: 0 microversion: 2.1 time: 0.040903 Aug 11 16:32:03.028873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 287/610] 10.222.0.43 () {58 vars in 1215 bytes} [Thu Aug 11 16:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91804665 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:32:03.332847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:03.333461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:03.340369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.340888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.341507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:03.342381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.343009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.343435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:03.495354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:03.503286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8e9d128-df9e-4ca8-b48e-1d764c5827a8 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1662 microversion: 2.1 time: 0.174250 Aug 11 16:32:03.503856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 324/611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:03 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:03.773667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:03.774943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:03.783357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.783866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.784789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:03.785027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.785496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.786049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:03.889396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lazy-loading 'services' on Instance uuid 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:32:03.972490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f11d9a1e-0c5d-4ee7-8f6c-f4dfe8d92992 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments/bb194d16-400c-4811-8aac-a06b5d062531" status: 202 len: 0 microversion: 2.1 time: 0.202776 Aug 11 16:32:03.973105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 288/612] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:32:03 2022] DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments/bb194d16-400c-4811-8aac-a06b5d062531 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:32:03.982418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:03.984776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:03.991595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.992287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.993366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:03.994773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:03.995585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:03.996093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:04.029276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-098879e9-5218-4a8d-9dfd-41743ef0f17b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051702 Aug 11 16:32:04.029829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 325/613] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:03 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:04.526556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:04.527247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:04.533966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:04.534453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:04.534887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:04.535579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:04.536030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:04.536495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:04.663876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:04.671907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d4da6b9a-f830-4ddd-8b98-7ae64f9e7837 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1666 microversion: 2.1 time: 0.150700 Aug 11 16:32:04.672547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 289/614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:04 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:05.041272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:05.043938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:05.050481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:05.050945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:05.051381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:05.052066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:05.052537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:05.052952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:05.082180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15947448-91e6-421c-b60b-3395780acae8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 11 16:32:05.082727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 326/615] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:05 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:05.559324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:05.561786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:05.568302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:05.568779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:05.569209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:05.569887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:05.570333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:05.570750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:05.807129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-80aea221-5075-4b81-a25f-4ce1fb299978 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251651 Aug 11 16:32:05.808187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 290/616] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 16:32:05 2022] POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:06.094940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:06.097050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:06.104162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:06.104645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:06.105065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:06.105741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:06.106181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:06.106594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:06.134291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47e94303-92f5-4026-9044-cabb31d3a241 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Aug 11 16:32:06.134864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 327/617] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:06 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:07.147489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:07.149779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:07.156694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:07.157169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:07.157594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:07.158268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:07.158711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:07.159122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:07.189254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9cb7eaf2-3fdf-4dbe-a37e-0d040c02655b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046140 Aug 11 16:32:07.189810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 291/618] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:07 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:32:08.201841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:08.204003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:08.210701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:08.211189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:08.211622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:08.212345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:08.212798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:08.213549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:08.240067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:08.246637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3dc38d6-6660-4860-909a-057045e12aa4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Aug 11 16:32:08.247229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 328/619] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:08 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:09.259680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:09.264921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:09.268610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:09.269090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:09.269521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:09.270229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:09.270675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:09.271096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:09.301444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-df126f0d-db33-418e-b6b9-cecc1e763092 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Aug 11 16:32:09.301999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 292/620] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:09 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:10.314114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:10.316292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:10.325090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.325576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.326011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.326701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.327150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.327574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.356487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb3f56a5-7bb8-4d75-b1e8-56fc09635276 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046275 Aug 11 16:32:10.357071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 329/621] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:10 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 16:32:10.416864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:10.417342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:10.423852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.424371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.424807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.425490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.425939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.426360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.453344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:32:10.528479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4915c979-017d-4d3a-9bc6-affccd3677ef tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 204 len: 0 microversion: 2.1 time: 0.115474 Aug 11 16:32:10.529059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 293/622] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:32:10 2022] DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:32:10.537197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:10.538654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:10.546990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.547453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.547879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.548821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:10.549266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:10.549684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:10.677483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:10.685337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa2f6167-8c7c-4360-8752-e41dfe26f133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1682 microversion: 2.1 time: 0.151956 Aug 11 16:32:10.685900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 330/623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:10 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:11.707114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:11.707870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:11.714518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:11.714998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:11.715433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:11.716152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:11.716685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:11.717110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:11.846705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:11.854945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-06d659e1-4c60-4bb7-b274-5c75249f39dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1682 microversion: 2.1 time: 0.152013 Aug 11 16:32:11.855502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 294/624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:11 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:12.876247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:12.876863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:12.883443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:12.883925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:12.885287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:12.886278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:12.886735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:12.887160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:13.023724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:13.031445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91f9c1c9-2d86-4327-bb18-0dd2ca007112 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1682 microversion: 2.1 time: 0.159315 Aug 11 16:32:13.032013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 331/625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:12 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:14.052439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:14.053053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:14.059805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:14.060321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:14.060751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:14.061433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:14.061876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:14.062292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:14.191947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:14.200330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e46fafc2-988e-4a52-8005-7d5fe6a1ca59 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1682 microversion: 2.1 time: 0.151641 Aug 11 16:32:14.200905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 295/626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:14 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:15.222739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:15.223351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:15.225943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:15.232590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:15.233071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:15.233504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:15.234198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:15.234642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:15.235059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:15.298839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:15.310726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-524bb7fb-77cd-4c5a-9750-de18ccb2083e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1614 microversion: 2.1 time: 0.091707 Aug 11 16:32:15.311507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 332/627] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:15 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:15.467147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bfca9f-d7bf-443a-9d7e-70b0774da2b0", "name": "network-vif-deleted", "tag": "1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:15.480835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:15.481893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:15.482682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:15.497839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] Creating event network-vif-deleted:1a0ec0a7-a845-4cb4-8998-9e99fd77ee6f for instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 on hv-cinder-85220 Aug 11 16:32:15.509118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-675572fd-eec5-4522-b0c0-5320794b2d62 req-5ffee044-e4d2-4fba-8927-8ec8a2b8d39f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043142 Aug 11 16:32:15.510505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 296/628] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:16.148938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:16.149434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:16.156555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.156555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.156555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.156555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.160196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.160196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.188679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f97117c-e74e-4ff1-aac6-ab51b757b987 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments/bd5dab74-6c99-4e8a-8028-ce66ce69e580" status: 200 len: 194 microversion: 2.20 time: 0.043798 Aug 11 16:32:16.189381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 333/629] 10.222.0.43 () {60 vars in 1454 bytes} [Thu Aug 11 16:32:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments/bd5dab74-6c99-4e8a-8028-ce66ce69e580 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:16.271887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:16.272493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:16.279656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.280180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.280619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.281323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.281803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.282227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.333059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:16.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:16.340952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.341802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.342680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.343448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.343909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.344371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.371285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lazy-loading 'services' on Instance uuid 228fe15a-7159-4dbe-89fa-2340fc3c0558 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:32:16.394966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.395707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.396183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.396711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lazy-loading 'fault' on Instance uuid 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:32:16.444665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:16.453622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da27fcb2-7f06-4fd7-b0b3-584ee613cf04 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 200 len: 1331 microversion: 2.1 time: 0.124335 Aug 11 16:32:16.471469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 334/630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:16 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:16.480165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-854a688b-47ea-4c77-aec6-5ef8f058d09c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments/bd5dab74-6c99-4e8a-8028-ce66ce69e580" status: 202 len: 0 microversion: 2.20 time: 0.212430 Aug 11 16:32:16.481043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 297/631] 10.222.0.43 () {60 vars in 1457 bytes} [Thu Aug 11 16:32:16 2022] DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments/bd5dab74-6c99-4e8a-8028-ce66ce69e580 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:32:16.489993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:16.495313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:16.501754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.502799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.503609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.504914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:16.505421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:16.505888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:16.558662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce71bf87-074c-4271-bef2-09e67d1e5088 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073167 Aug 11 16:32:16.559247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 335/632] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:17.479902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:17.480498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:17.487158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:17.487690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:17.488336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:17.489029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:17.489472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:17.489885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:17.504270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 HTTP/1.1 Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:32:17.505723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:32:17.507499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '96bfca9f-d7bf-443a-9d7e-70b0774da2b0'} Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:32:17.508661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:32:17.510854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:32:17.514000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:32:17.514000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4b7b69d-41ed-4c70-b94d-703a2431028e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 404 len: 111 microversion: 2.1 time: 0.031907 Aug 11 16:32:17.514000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 298/633] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:17 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:32:17.517512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c67e911a-92e4-4731-8344-1a493be1564f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '.version_select at 0x7f61434e3310>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:17.538603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c67e911a-92e4-4731-8344-1a493be1564f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099645941" status: 202 len: 0 microversion: 2.1 time: 0.024840 Aug 11 16:32:17.539164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 336/634] 10.222.0.43 () {58 vars in 1221 bytes} [Thu Aug 11 16:32:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099645941 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:32:17.571099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:17.573672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:17.579845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:17.580444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:17.580942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:17.581692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:17.582227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:17.582710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:17.611783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:17.616842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0184af22-5dd3-4689-9661-f9f4321f8344 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049788 Aug 11 16:32:17.617397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 299/635] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:18.169841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed479bab-86b1-44b1-9666-e5dda6133525 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: .version_select at 0x7f614355aca0>, body: {"keypair": {"name": "tempest-keypair-1591501794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4dLRaRGsXz4ztFYYYcrdFPcfCiGw5Uj0UVPHMbRb6mw6YJvenawlw7wzYD83q4n3gFTdogmU5ruTtvOl91LdO2r7Zyl9MEz2CiXyRr9ICrIyL5KUbdOWsw5EVGpSLfMg=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:18.186786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-ed479bab-86b1-44b1-9666-e5dda6133525 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:32:18.190627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-ed479bab-86b1-44b1-9666-e5dda6133525 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:32:18.212389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed479bab-86b1-44b1-9666-e5dda6133525 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046588 Aug 11 16:32:18.212962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 337/636] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:32:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:32:18.629122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:18.631347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:18.639561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:18.640201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:18.640632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:18.641321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:18.641794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:18.642210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:18.674037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2ab84f0b-6888-43a9-a53c-ec8c5c5c33a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048926 Aug 11 16:32:18.674790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 300/637] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:19.468388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1775961099", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247ee74-ce66-47ac-ae21-9c4793c44289"}], "security_groups": [{"name": "tempest-securitygroup--1223784862"}], "key_name": "tempest-keypair-1591501794", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:32:19.571588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] validate_networks() for [('6247ee74-ce66-47ac-ae21-9c4793c44289', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:32:19.686089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:19.688390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:19.694814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:19.695300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:19.695742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:19.696481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:19.697080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:19.697585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:19.728668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bd9cf314-1c60-4f27-99c9-b204fda80c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046037 Aug 11 16:32:19.729084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 301/638] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:20.162538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:32:20.162962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:32:20.163435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:32:20.163841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:32:20.164323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:32:20.173427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:20.173901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:20.174331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:20.175048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:20.175499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:20.175918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:20.192740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:32:20.197190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:32:20.208388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:32:20.210602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:32:20.258086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a28e794-2bd4-4f7c-86b8-613527bdd542 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.795165 Aug 11 16:32:20.258794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 338/639] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:32:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:32:20.270208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-208a39f4-d2a7-48a1-b85a-87161796c6a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:20.271097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-208a39f4-d2a7-48a1-b85a-87161796c6a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:20.330656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-208a39f4-d2a7-48a1-b85a-87161796c6a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:20.338119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-208a39f4-d2a7-48a1-b85a-87161796c6a1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1242 microversion: 2.1 time: 0.071726 Aug 11 16:32:20.338677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 302/640] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:20 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:20.741394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:20.743600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:20.751974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:20.752510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:20.752948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:20.753650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:20.754105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:20.754529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:20.784895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ee445f3-9aae-4fb9-94aa-2b1cc7945175 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048074 Aug 11 16:32:20.785445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 339/641] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:21.358765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:21.359304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:21.361656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:21.367605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:21.368080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:21.368542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:21.369798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:21.370244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:21.370688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:21.429923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:21.438163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41b8511d-84dd-40f4-b90e-4fe8da526a78 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083377 Aug 11 16:32:21.439045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 303/642] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:21 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:21.797675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:21.799974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:21.806344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:21.806858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:21.807288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:21.808275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:21.808727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:21.809142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:21.838023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-87bb9db3-60eb-4580-ba4f-2e85d0ccbda2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043591 Aug 11 16:32:21.838695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 340/643] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:22.458947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:22.459502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:22.466638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:22.467120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:22.467555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:22.468286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:22.468737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:22.469167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:22.531591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:22.539425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bfa42fb8-7a9b-4aa2-af27-bbff5c3be559 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084375 Aug 11 16:32:22.539994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 304/644] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:22 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:22.850282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:22.852457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:22.859395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:22.865464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:22.866565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:22.867299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:22.867766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:22.868234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:22.897540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c19df17b-b4b0-43d3-80fe-b1c21793c3fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051161 Aug 11 16:32:22.898087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 341/645] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:23.560823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:23.561467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:23.567897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:23.568419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:23.568882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:23.569571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:23.570023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:23.570447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:23.630665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:23.638604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2f2d2913-f904-4872-829f-a87c93d16481 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081982 Aug 11 16:32:23.639165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 305/646] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:23 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:23.909816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:23.911932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:23.918536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:23.919010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:23.919436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:23.920137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:23.920583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:23.920996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:23.949925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90683ea1-d323-45a9-922b-5a684865220c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044019 Aug 11 16:32:23.950462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 342/647] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:24.660119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:24.660747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:24.667667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:24.668172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:24.668614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:24.669298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:24.669752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:24.670176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:24.730708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:24.738119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bc0d7cfd-5506-44dd-86de-5691459817c8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081873 Aug 11 16:32:24.738688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 306/648] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:24 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:24.962031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:24.964768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:24.971151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:24.971637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:24.972072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:24.972790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:24.973244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:24.973672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:25.003818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a3b11cf6-2e2f-4b8b-a30a-674775cd801d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045666 Aug 11 16:32:25.004436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 343/649] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:25.760528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:25.761145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:25.767577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:25.768060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:25.768534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:25.769223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:25.769676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:25.770098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:25.832751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:25.840665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d31653c8-c4fb-419c-85ab-f608cbdf1da7 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084568 Aug 11 16:32:25.841224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 307/650] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:25 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:26.016425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:26.018467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:26.025482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:26.026037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:26.026467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:26.027144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:26.027588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:26.028003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:26.058547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a611d107-80cb-40c0-ad9e-2543db0eca5b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046048 Aug 11 16:32:26.059105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 344/651] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:26.862460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:26.863071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:26.869810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:26.870293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:26.870728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:26.871414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:26.871864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:26.872324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:26.937383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:26.944612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cfa85fe3-2ff9-464b-8ced-3bb02dcd7173 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.086217 Aug 11 16:32:26.945168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 308/652] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:26 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:27.070759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:27.072968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:27.079390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:27.079869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:27.080346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:27.081027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:27.081476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:27.081895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:27.111145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7178c1fa-8ffa-4510-9ab8-6eb58d81e6e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044351 Aug 11 16:32:27.111681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 345/653] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:27.966232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:27.966865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:27.973283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:27.973757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:27.974182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:27.974862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:27.975303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:27.975722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:28.035524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:28.043814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c60673c2-ebdb-4b25-9796-e009f6145892 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081987 Aug 11 16:32:28.044587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 309/654] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:27 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:28.124044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:28.126216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:28.132596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:28.133074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:28.133505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:28.134705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:28.135427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:28.135852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:28.164606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d1095e04-de1b-4bc5-8042-fb0beea232d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044880 Aug 11 16:32:28.165148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 346/655] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:29.064835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:29.065446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:29.072648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:29.072942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:29.073376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:29.074058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:29.074508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:29.074929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:29.136360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:29.143528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0c42de03-0b97-4315-ab9a-5b1423e14b0b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082550 Aug 11 16:32:29.144134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 310/656] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:29 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:29.177583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:29.179700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:29.187026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:29.187507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:29.187998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:29.188712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:29.189161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:29.189583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:29.216066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:29.221142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-696d61fa-069b-4538-886f-00224cb08952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047612 Aug 11 16:32:29.221692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 347/657] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:30.166490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:30.168857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:30.175362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:30.175834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:30.176291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:30.177003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:30.177529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:30.177942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:30.234448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:30.236572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:30.239035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:30.239841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=10 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:30.241139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:30.246322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:30.246806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:30.247238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:30.247927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:30.248400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:30.248821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:30.249089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e7647dea-91b8-472a-86c2-133da1074935 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.087176 Aug 11 16:32:30.249653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 311/658] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:30 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:30.278319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f9b0660-7c02-4f03-ae89-d503a77c24d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047830 Aug 11 16:32:30.278857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 348/659] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:31.270612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:31.271219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:31.273095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:31.278898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:31.279402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:31.279831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:31.280546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:31.280993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:31.281412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:31.291117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:31.293338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:31.299778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:31.300361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:31.300869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:31.301545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:31.301989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:31.302405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:31.332693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2a4faaa-afba-4323-bd53-c8cee3072e0d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045578 Aug 11 16:32:31.333566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 349/660] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:31.345671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:31.353632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f5ea32be-be5f-40c9-8f60-42d613c57048 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.086184 Aug 11 16:32:31.354065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 312/661] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:31 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:32.344939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:32.347045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:32.354049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:32.354525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:32.354955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:32.355631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:32.356093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:32.356521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:32.375841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:32.376523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:32.383088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:32.383576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:32.384014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:32.385047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:32.385511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:32.385938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:32.387667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29974808-f4aa-4708-ab79-6bbadeec6aa3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046531 Aug 11 16:32:32.388085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 350/662] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:32.446160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:32.453591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f58c33b6-c32b-4624-b120-c07119522986 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081583 Aug 11 16:32:32.454158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 313/663] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:32 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:33.398753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:33.401591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:33.407943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:33.408594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:33.408974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:33.409670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:33.410125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:33.410549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:33.439792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd431422-4737-41bf-b014-e9fc8052d3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044969 Aug 11 16:32:33.440375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 351/664] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:33.474730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:33.475338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:33.482338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:33.482815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:33.483245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:33.483931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:33.484407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:33.484831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:33.547570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:33.554930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f904e962-5d92-47e8-b7cf-cb48b6b45c29 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084081 Aug 11 16:32:33.555485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 314/665] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:33 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:34.452470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:34.454608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:34.460959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:34.461434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:34.461864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:34.463141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:34.463590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:34.464012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:34.491771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50654162-7aee-438f-b8fa-2777686b056c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043204 Aug 11 16:32:34.492339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 352/666] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:34.575945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:34.576578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:34.582971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:34.583441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:34.583870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:34.584577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:34.585020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:34.585436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:34.645123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:34.652569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ea1c6cfd-5b22-40e5-bcf0-84991db6adab tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081047 Aug 11 16:32:34.653124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 315/667] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:34 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:35.504807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:35.506931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:35.513337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:35.513819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:35.514249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:35.514938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:35.515389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:35.515810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:35.544995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7bda0a60-ff39-43d0-ae41-6c78ca09c47f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044168 Aug 11 16:32:35.545531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 353/668] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:35.673047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:35.673649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:35.680048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:35.680552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:35.681227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:35.681897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:35.682344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:35.683024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:35.746320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:35.753393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a30b4c72-8cc8-4799-be24-e1519bd4f88a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084168 Aug 11 16:32:35.753950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 316/669] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:35 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:36.558103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:36.560312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:36.566691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:36.567177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:36.567615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:36.568342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:36.568798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:36.569224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:36.597652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f01de9c6-7cec-426a-8aed-c275eacc3274 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044411 Aug 11 16:32:36.598203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 354/670] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:36.775443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:36.776149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:36.782628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:36.783139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:36.783577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:36.784304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:36.784760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:36.785185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:36.800188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:36.845180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:36.852398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-08967b81-26ba-484e-8f61-2732d5340acb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081592 Aug 11 16:32:36.853597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 317/671] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:36 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:37.609333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:37.611449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:37.617799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:37.618278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:37.619254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:37.619928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:37.620405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:37.620823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:37.649796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-603d02cf-29fb-465d-a82d-979cc6919fa2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044347 Aug 11 16:32:37.650584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 355/672] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:37.873696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:37.874295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:37.880883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:37.881356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:37.881785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:37.882460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:37.882905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:37.883377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:37.944401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:37.951981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e2b9f945-1d95-48bb-b6de-68b9693ea122 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082165 Aug 11 16:32:37.952570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 318/673] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:37 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:38.031058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:38.033239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:38.039061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.039539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.039967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.041237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.041692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.042110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.071061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00ab2e7c-6b07-4346-83d7-2cd6fff3311e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043822 Aug 11 16:32:38.071638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 356/674] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:32:38 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 16:32:38.132078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:38.132543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:38.138546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.139016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.139453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.140130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.140582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.140998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.164609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:32:38.240035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0811242a-df7b-4c0b-a14e-e2ba4e5cf36e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 204 len: 0 microversion: 2.1 time: 0.111554 Aug 11 16:32:38.240633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 319/675] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:32:38 2022] DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:32:38.249158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:38.249765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:38.255656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.256139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.256566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.257245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.257699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.258115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.385389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:38.392817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e198063-e69e-4f08-b3f8-a559aa819651 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.147688 Aug 11 16:32:38.393369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 357/676] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:38 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:38.662640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:38.664956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:38.670933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.671404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.671838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.672542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.672985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.673401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.704779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bba1336f-2730-46ac-89c4-ddf6a3ea9e45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046424 Aug 11 16:32:38.705320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 320/677] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:38.972821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:38.973335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:38.980466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.980955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.981494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:38.982318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:38.982776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:38.983199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:39.044995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:39.052371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b1f277f-bc07-4506-b444-a7d86757b6f4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083469 Aug 11 16:32:39.052940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 358/678] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:38 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:39.414480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:39.415093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:39.422279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:39.422758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:39.423193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:39.423876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:39.424352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:39.424778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:39.558909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:39.566638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9d0e9357-c44f-44fd-92cf-b89a42dda4de tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.155998 Aug 11 16:32:39.567526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 321/679] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:39 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:39.718142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:39.720401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:39.726495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:39.726979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:39.727437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:39.728973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:39.729560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:39.729987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:39.760362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8874be0e-c4a1-4e8f-8dc1-353257d96c22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046312 Aug 11 16:32:39.760919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 359/680] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:40.074752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:40.075365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:40.081370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.081861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.082290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.082981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.083437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.083870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.147340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:40.155378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-433b7c23-b754-4f17-b001-9e86cdb32eee tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084787 Aug 11 16:32:40.155947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 322/681] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:40 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:40.587890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:40.588539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:40.595080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.595620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.596054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.596758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.597206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.597622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.730473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:40.738229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afde9e84-084c-4c91-be4e-280603b409fa tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154226 Aug 11 16:32:40.738959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 360/682] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:40 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:40.772628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:40.774821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:40.781262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.781769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.782200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.782888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:40.783335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:40.783752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:40.812897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b2b08724-1a04-4983-b516-e775806b22af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044213 Aug 11 16:32:40.813445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 323/683] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:41.176420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:41.177038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:41.183889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.184468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.184901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.185610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.186066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.186487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.245993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:41.253296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34d56de4-4224-428d-8215-47f34faa1779 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.080782 Aug 11 16:32:41.253857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 361/684] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:41 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:41.760577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:41.761182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:41.767212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.767693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.768145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.768841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.769290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.769715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.825076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:41.828442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:41.837934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.838431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.838857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.840189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:41.840189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:41.840399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:41.871048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a269da9f-db6b-4159-a88d-aac30541c3d6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050515 Aug 11 16:32:41.871621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 362/685] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:41.905915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:41.913366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f32ed632-05e5-485f-a8f7-80b00f54ffbd tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.157218 Aug 11 16:32:41.913923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 324/686] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:41 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:42.273404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:42.273944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:42.280085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.280594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.281031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.281723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.282179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.282602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.342493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:42.349859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-720eb7e3-5d57-478d-86b1-53dfb961947c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.080397 Aug 11 16:32:42.350422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 363/687] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:42 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:42.883584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:42.886018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:42.892631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.893116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.893548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.894237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.894695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.895112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.924363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1b1b6414-2f83-48b5-a63f-d71db29ef8a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Aug 11 16:32:42.924938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 325/688] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:42.935178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:42.935787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:42.942166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.942641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.943073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.943751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:42.944300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:42.944722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:42.960561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:43.077686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:43.085174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ecb070ae-0b1b-420f-b6f9-8b64ca3878d9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154510 Aug 11 16:32:43.085737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 364/689] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:42 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:43.371870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:43.372531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:43.378526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:43.379011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:43.379441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:43.380142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:43.380594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:43.381014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:43.441783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:43.449160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7c3767ed-3d1f-447e-b369-6ec02bb83d3f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082315 Aug 11 16:32:43.449729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 326/690] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:43 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:43.935845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:43.938109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:43.944555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:43.944966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:43.945404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:43.946102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:43.947208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:43.947648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:43.976644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33b18820-c196-429e-bfd0-56f995f89952 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045091 Aug 11 16:32:43.977194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 365/691] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:44.106244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:44.106858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:44.113309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.113793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.114237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:44.114931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.115387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.115817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:44.247630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:44.255236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9abef44f-9783-493f-a683-bf7a64d4e80f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.152870 Aug 11 16:32:44.255807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 327/692] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:44 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:44.469735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:44.470286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:44.476196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.476670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.477097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:44.477781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.478215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.478634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:44.537220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:44.544547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c381957f-6001-4b03-80b5-f6dbfe7038cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.078760 Aug 11 16:32:44.545098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 366/693] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:44 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:44.988795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:44.990830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:44.997242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.997723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.998284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:44.998835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:44.999282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:44.999698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:45.032593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e06a3819-f922-4a22-ab4a-21ac4fa8481d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047730 Aug 11 16:32:45.033144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 328/694] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:45.278152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:45.278676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:45.281028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:45.286791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:45.287280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:45.287713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:45.288470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:45.288922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:45.289403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:45.420181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:45.428219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5c615a41-1ee9-4280-bd03-0ead039df206 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154875 Aug 11 16:32:45.428780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 367/695] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:45 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:45.566576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:45.567201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:45.574598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:45.575072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:45.575501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:45.576211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:45.576660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:45.577077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:45.639106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:45.646746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bc816f51-523a-43ac-bb20-a92d6f5d1d52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084003 Aug 11 16:32:45.647306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 329/696] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:45 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:46.046633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:46.048922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:46.055266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.058329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.058730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.059433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.059882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.060327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.090148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-998d2dea-8470-4e1c-903a-673f9b847fd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049080 Aug 11 16:32:46.090714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 368/697] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:46.450740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:46.452032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:46.460415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.461316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.462684 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.463915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.464798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.465239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.601522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:46.609606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-051dab6f-05c7-4f3c-acce-2306fc552a07 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.163711 Aug 11 16:32:46.610170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 330/698] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:46 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:46.669128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:46.669796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:46.676255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.676741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.677180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.677869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:46.678323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:46.678746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:46.744180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:46.751761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0b697deb-31ed-4459-afa3-e15e9bfc872b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.087192 Aug 11 16:32:46.752409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 369/699] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:46 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:47.102340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:47.104547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:47.110826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.111201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.111638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.112356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.112815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.113245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.142952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f02e1f37-83b3-4a63-9f82-e1aa6f316e50 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044553 Aug 11 16:32:47.143511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 331/700] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:47.630805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:47.631420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:47.638077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.638564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.639002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.639691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.640183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.640614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.766224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:47.772585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:47.773199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:47.773866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d20a4cb5-3dc4-4e57-acae-c3fdd8e89b70 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.146949 Aug 11 16:32:47.774456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 370/701] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:47 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:47.780251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.780738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.781175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.781867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:47.782320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:47.782745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:47.798027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:47.850995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:47.858680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-64415104-6913-43f6-8f15-997e934730c4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.089853 Aug 11 16:32:47.859246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 332/702] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:47 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:48.154975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:48.157153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:48.163027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.163514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.163954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.164677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.165150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.165570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.195308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f1d2353-0a52-403f-8cf8-e680f6f7d9e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Aug 11 16:32:48.195863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 371/703] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:48.795742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:48.796371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:48.802929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.803436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.803869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.804584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.805034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.805457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.878718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:48.879330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:48.886165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.886651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.887084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.887774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:48.888265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:48.888686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:48.935357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:48.943903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-28ae94ee-5e10-4516-b3bb-ac08d2e10ab7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.151987 Aug 11 16:32:48.944781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 333/704] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:48 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:48.951052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:48.958470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3aeec055-8c7b-405e-b2ea-ef46d17ac962 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083622 Aug 11 16:32:48.959020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 372/705] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:48 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:49.208324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:49.210730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:49.217400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.217889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.218325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:49.219053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.219503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.219930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:49.249146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-05279f1b-fd32-4721-b76b-3470687a482e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044887 Aug 11 16:32:49.249701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 334/706] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:49.964996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:49.965607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:49.972314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.972796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.973227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:49.974002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.974455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.974874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:49.979030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:49.979638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:49.985983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.986466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.986898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:49.987581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:49.988041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:49.988486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:50.050288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:50.059191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a7b06250-675b-4369-9e25-bdce398d951f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084369 Aug 11 16:32:50.059777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 335/707] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:49 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:50.111506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:50.119508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24d68acf-7b5b-4ad5-89d9-8bbee8ca2eb4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.158384 Aug 11 16:32:50.120061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 373/708] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:49 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:50.262350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:50.264781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:50.270994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:50.271480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:50.271916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:50.272638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:50.273090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:50.273760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:50.305451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d919dd21-fe3d-419d-8bb5-0c4d07263d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047449 Aug 11 16:32:50.310110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 336/709] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:51.078772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:51.079381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:51.085943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.086415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.087526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.089033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.089484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.089907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.140499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:51.141064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:51.147372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.147851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.148325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.149018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.150087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:51.150678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.151129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.157610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8560d14c-9e5d-4506-92ee-46cb561814db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082728 Aug 11 16:32:51.158164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 374/710] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:51 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:51.282986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:51.291246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d958f6ed-c512-4db6-8b25-f05ad9504c6c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154717 Aug 11 16:32:51.291809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 337/711] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:51 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:32:51.317591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:51.319718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:51.325655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.326134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.326561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.327250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:51.327695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:51.328185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:51.359025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95774933-469e-4a64-a978-71524306b9c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045299 Aug 11 16:32:51.359627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 375/712] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:52.178845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:52.179391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:52.182375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:52.187974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.188489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.188926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.189622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.190072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.190498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.252918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:52.260268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4e2fec78-243d-494e-9ce7-8e305a64d261 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.085329 Aug 11 16:32:52.260839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 338/713] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:52 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:52.312636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:52.313242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:52.319627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.320132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.320559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.321268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.321712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.322126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.371550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:52.373693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:52.379840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.380359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.380789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.382017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:52.382017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:52.382392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:52.412750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f5864ab3-52ff-48b4-ac1c-12b2e36c684a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045725 Aug 11 16:32:52.413544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 339/714] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:52.455160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:52.463461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3904ef99-3740-44cf-aadc-f7499cc5ff67 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154664 Aug 11 16:32:52.464012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 376/715] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:52 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:53.281070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:53.281673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:53.287982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.288489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.288915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.289587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.290102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.290791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.350496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:53.358003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2f38e856-5065-4b44-acaa-eb31c241b619 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.080822 Aug 11 16:32:53.358555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 340/716] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:53 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:53.425531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:53.427694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:53.436750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.437473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.437660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.438359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.438939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.439368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.471358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2180547-151e-4b25-9d1a-3b3d30028f26 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049772 Aug 11 16:32:53.471916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 377/717] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:53.483965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:53.484659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:53.490587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.491067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.491501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.492211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:53.492662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:53.493596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:53.623127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:53.630578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-34a75d13-620e-45e3-a37f-5bd2e5b0ab5c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.150418 Aug 11 16:32:53.631139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 341/718] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:53 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:54.378737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:54.379352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:54.385361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.385861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.386298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.386983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.387434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.387856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.450403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:54.457795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9e31bd4-d8c0-4b16-a844-adea2a529b94 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082880 Aug 11 16:32:54.458359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 378/719] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:54 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:54.483403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:54.485625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:54.492288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.492783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.493871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.494645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.495103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.495529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.525987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-891b4878-fa6a-4c10-8afc-fe709edbdcdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046530 Aug 11 16:32:54.526564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 342/720] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:54.652507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:54.653047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:54.658979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.659457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.659892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.660615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:54.661066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:54.661488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:54.788780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:54.796747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4311cf6-1e97-4e07-8b87-0c62b6050339 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.148394 Aug 11 16:32:54.797303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 379/721] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:54 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:55.482234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:55.482842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:55.489306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.489869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.490207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.490892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.491342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.491766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.537626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:55.539780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:55.547256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.547734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.548191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.548913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.549343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.549768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.584429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d11dd9e1-d752-4fbc-be8a-d3c84f5f5958 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050726 Aug 11 16:32:55.589752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 380/722] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:32:55.714841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:55.722420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fa0fa7f5-9eb3-49ec-b419-4436b3119f2e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.244133 Aug 11 16:32:55.722994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 343/723] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:55 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:55.817235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:55.817851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:55.823775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.824289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.824725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.825409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:55.825860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:55.826280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:55.830188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:32:55.953482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:55.960966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cba5797b-e2d9-4128-8bb9-6e7cf7da5ac9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.147558 Aug 11 16:32:55.961529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 381/724] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:55 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:56.597563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:56.599738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:56.606893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.607368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.607796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:56.608542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.609005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.609500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:56.639335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-86943d66-c6b4-4783-8a76-baaf9196e4e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045725 Aug 11 16:32:56.639894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 344/725] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:56.744663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:56.745267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:56.751665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.752167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.752596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:56.753271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.753714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.754126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:56.871278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:56.878684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ee2a876-84e9-4223-871c-95cf1aaa7e20 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.138525 Aug 11 16:32:56.879241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 382/726] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:56 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:56.983418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:56.984018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:56.989932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.990404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.990832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:56.991512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:56.991958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:56.992464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:57.122750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:57.130266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-35fb1fc9-8ee8-4a7c-9ba8-998c3f2c64a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.150668 Aug 11 16:32:57.130837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 345/727] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:56 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:57.651834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:57.653984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:57.659948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:57.660449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:57.660883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:57.661561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:57.662009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:57.662428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:57.692570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-383966be-4fea-42b2-94b8-c002bfb082e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Aug 11 16:32:57.693332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 383/728] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:57.899836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:57.900607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:57.907077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:57.907501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:57.907936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:57.908658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:57.909111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:57.909537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:57.971743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:57.979114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-16253e1f-2bde-49b4-9112-eec05e32da95 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083157 Aug 11 16:32:57.979677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 346/729] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:57 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:58.152207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:58.152810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:58.158945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:58.159364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:58.159791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:58.160493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:58.160939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:58.161357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:58.288063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:58.296004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d099ea2e-fb4f-4acc-936c-ec2d98437450 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.148004 Aug 11 16:32:58.296602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 384/730] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:58 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:58.706139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:58.708306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:58.715572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:58.716056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:58.716512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:58.717197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:58.717643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:58.718079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:58.748900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c14a444e-7fc5-42f4-9e27-fd01d689a789 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046747 Aug 11 16:32:58.749460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 347/731] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:32:58.999170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:58.999693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:59.005691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.006166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.006590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.007263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.007708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.008140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.069455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:59.077670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a06f6e2f-78ab-414b-bd5a-2f09c24553e0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082711 Aug 11 16:32:59.078235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 385/732] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:58 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:59.317872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:59.318488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:59.325559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.326042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.326477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.327161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.327611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.328033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.461024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:32:59.468683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c872b568-4281-47bd-88fc-9877a1a49f18 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.154561 Aug 11 16:32:59.469242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 348/733] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:32:59 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:32:59.761394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:32:59.763514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:32:59.769932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.770414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.770848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.771538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:32:59.771991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:32:59.772443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:32:59.802408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-08c8fbcc-1975-460d-912a-e3a155962c3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045076 Aug 11 16:32:59.802981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 386/734] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:32:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:00.101332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:00.101937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:00.108528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.108999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.109425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.110101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.110540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.110953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.113477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:00.172586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:00.179883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c7a5cb75-fbfe-4248-8301-ea632d73565f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082460 Aug 11 16:33:00.180502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 349/735] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:00 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:00.489864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:00.490479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:00.496731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.497217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.497652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.498346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.498807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.499235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.629681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:00.637692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c7a481b-d41c-4aec-8c12-a348a32c7e2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.151778 Aug 11 16:33:00.638249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 387/736] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:00 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:00.815207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:00.817441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:00.825003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.825496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.825935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.826627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:00.827083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:00.827513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:00.863060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aaee6da3-baca-4141-bebc-2f87ab4d92a2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051850 Aug 11 16:33:00.863632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 350/737] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:01.200220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:01.200830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:01.207619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.208116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.208555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.209230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.209674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.210090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.271234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:01.278820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-045a50aa-77a3-4a36-9040-361bd236655a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082844 Aug 11 16:33:01.279377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 388/738] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:01 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:01.658535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:01.659138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:01.665146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.665640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.666048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.666723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.667816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.668262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.799063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:01.806554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-979edfd7-b0b2-4dd5-b516-9e33d56f172a tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.151915 Aug 11 16:33:01.807106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 351/739] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:01 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:01.875486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:01.877675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:01.883610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.884092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.884561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.885250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:01.886214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:01.886643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:01.915849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-865c98b4-fc22-4f38-912e-c977f498c1ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044287 Aug 11 16:33:01.916362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 389/740] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:02.299304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:02.299905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:02.305864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.306339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.306766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.307442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.308771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.309208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.368182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:02.376435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-805321a0-e595-48ae-af6d-1f2ea85f823b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.081025 Aug 11 16:33:02.376989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 352/741] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:02 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:02.827310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:02.827909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:02.834874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.835353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.835786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.836495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.836944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.837364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.928389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:02.930509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:02.937279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.937756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.938185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.938868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:02.939309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:02.939793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:02.967677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:02.969886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9c4083c6-1ae0-427b-a391-87e799d6ea71 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045248 Aug 11 16:33:02.970687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 353/742] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:02.975387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c91a243a-f7f5-46c0-ab1a-ed05be7b0832 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.151930 Aug 11 16:33:02.976036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 390/743] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:02 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:03.397908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:03.398542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:03.405883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:03.406362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:03.406798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:03.407481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:03.407929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:03.408376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:03.470263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:03.477543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9bc55611-0ac3-4fe8-b969-b821d5a63041 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083480 Aug 11 16:33:03.478103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 354/744] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:03 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:03.983439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:03.985651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:03.992080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:03.992598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:03.993034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:03.993740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:03.994182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:03.994608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:04.027248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a333b1cc-063a-4f11-a13e-f02a17636afe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048532 Aug 11 16:33:04.027829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 391/745] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:04.112413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:04.113030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:04.118935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:04.119429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:04.119873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:04.121232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:04.121681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:04.122105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:04.247394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:04.255030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b2a01101-fb5c-489f-8603-afdb95d83263 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.261019 Aug 11 16:33:04.255605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 355/746] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:03 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:04.498716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:04.499257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:04.505199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:04.505682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:04.506118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:04.506805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:04.507256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:04.507678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:04.572463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:04.580666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a9c09611-4ecc-4fb5-94ed-bf02bd40548a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.086179 Aug 11 16:33:04.581227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 392/747] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:04 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:05.040185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:05.042715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:05.049567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.050055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.050494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.051250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.051755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.052223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.084255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dd79fad1-da00-46d7-83a9-869ba96ad14f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048017 Aug 11 16:33:05.085002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 356/748] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:05.275809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:05.276499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:05.282910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.283390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.283818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.284529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.284975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.285390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.412650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:05.420767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d468d573-3e2a-489b-a9f4-4f124c6c26a1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.148730 Aug 11 16:33:05.421326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 393/749] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:05 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:05.602420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:05.603031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:05.609610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.610088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.610530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.611215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:05.611667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:05.612091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:05.675788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:05.683619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a6a8db86-7c94-4223-95ac-dc9b0488f085 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.084788 Aug 11 16:33:05.684197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 357/750] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:05 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:06.096390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:06.098731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:06.104983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.105560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.105992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.106679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.107128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.107577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.141763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-050cd025-dce8-4448-89da-82aed03e83fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049300 Aug 11 16:33:06.142401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 394/751] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:06.442458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:06.443069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:06.449938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.450420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.450858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.451548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.451997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.452448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.580963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:06.588345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9b2ae585-5456-4dc5-8f87-c7e979622aab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.149713 Aug 11 16:33:06.589924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 358/752] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:06 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:06.704876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:06.705487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:06.711828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.712379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.712815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.713502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:06.714482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:06.714901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:06.780150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:06.787489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eb58f9fb-da20-4920-9d49-8dffe9557696 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.086447 Aug 11 16:33:06.788049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 395/753] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:06 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:07.155245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:07.157552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:07.163926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.164600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.165034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.165762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.166212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.166648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.200914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a37c949-6175-4aad-82c5-d51ba95adc46 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050058 Aug 11 16:33:07.206998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 359/754] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:07.610801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:07.611409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:07.617408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.617885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.618315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.618995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.619444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.619865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.752775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:07.760334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9515ede-5221-4f21-baf2-ee3be79dd606 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.153365 Aug 11 16:33:07.761140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 396/755] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:07 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:07.809121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:07.809738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:07.816317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.816799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.817233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.817921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:07.818373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:07.818798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:07.879243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:07.887117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2007a576-6710-432f-9df0-7f2d7a0fb385 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082834 Aug 11 16:33:07.887678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 360/756] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:07 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:08.215048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:08.217180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:08.223137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.223613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.224044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.224764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.225209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.225627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.251134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:08.256223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f10979e4-ec0e-45e7-a090-37a290507482 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045833 Aug 11 16:33:08.256934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 397/757] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:08.781427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:08.782040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:08.788038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.788553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.788992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.789679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.790133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.790559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.908247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:08.908913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:08.915136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.915614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.916044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.916819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:08.917665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:08.917996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:08.919937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:08.928060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4871788c-4371-4109-b21f-72c54b116a0b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.150479 Aug 11 16:33:08.928730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 361/758] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:08 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:08.979355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:08.986854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af26455f-be7a-458e-9739-c55da8eb36e3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.082488 Aug 11 16:33:08.987414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 398/759] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:08 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:09.269577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:09.271744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:09.277655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:09.278135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:09.278570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:09.279259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:09.279724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:09.280138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:09.310256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-14a7d0f7-ded1-496b-8e2b-0a52a3b37029 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Aug 11 16:33:09.310772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 362/760] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:09.951002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:09.951632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:09.958106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:09.958592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:09.959032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:09.959721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:09.960202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:09.960630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:10.007767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:10.008380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:10.015415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:10.015894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:10.016396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:10.017073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:10.017516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:10.017935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:10.079254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:10.087712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d4b8ef8c-3471-4c8a-8c39-7f5723531679 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.083542 Aug 11 16:33:10.088585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 363/761] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:10 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:10.092048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:10.099548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6652dfd3-f9cd-42b9-87b7-0d324cbeb855 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.153027 Aug 11 16:33:10.100116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 399/762] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:09 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:10.321572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:10.324547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:10.330645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:10.331126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:10.331565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:10.332284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:10.332742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:10.333188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:10.362659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ae3c59c-ae73-4608-b4ff-96662cfa6224 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045078 Aug 11 16:33:10.363211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 364/763] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:11.111958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:11.112590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:11.119083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.119565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.120556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.121210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:11.121694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:11.121833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.122436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.122867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.127523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.128004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.128465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.129393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.129852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.130278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.186920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:11.194581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-506c28b4-7595-4183-b06c-87c6e97fd8db tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1246 microversion: 2.1 time: 0.086365 Aug 11 16:33:11.195520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 400/764] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:11 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:11.259709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:11.262514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:11.268937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e781f89e-063b-414d-bbab-a6642124c59f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.152708 Aug 11 16:33:11.269500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 365/765] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:11 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:11.376482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:11.378573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:11.384591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.385062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.386007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.386685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.387127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.387543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.415914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d52e196e-4498-4c16-8db0-06233ed021f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043505 Aug 11 16:33:11.416478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 401/766] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:11.435520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:11.436016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:11.441920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.442397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.442833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.443636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.444092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.471720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:33:11.545073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c5b4c127-fb31-4257-8e1e-32e621d87587 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.114059 Aug 11 16:33:11.545640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 366/767] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:33:11 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:33:11.553493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:11.554099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:11.560938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.561412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.561839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.562513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:11.562959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:11.563372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:11.691336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:11.698847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b702e82-c5dd-4c50-87a0-8097f6157bc5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1575 microversion: 2.1 time: 0.149069 Aug 11 16:33:11.699401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 402/768] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:12.218017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:12.218709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:12.225154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.225640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.226073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.226766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.227215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.227640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.289760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:12.290385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:12.292664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:12.297160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.297648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.298090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.298863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.299320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.299747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.300484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-26cdadc1-6348-4d76-8f2f-f8ee95c5176b tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1238 microversion: 2.1 time: 0.087431 Aug 11 16:33:12.301055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 367/769] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:12 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:12.428185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:12.429115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:12.430386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:12.437319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.437693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a49ce977-e320-484c-aeb7-4deeba40c2a4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.151874 Aug 11 16:33:12.437843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.438221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.438383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 403/770] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:12 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:12.438922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.439404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.439838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.469346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41c5a33d-f3a7-41e8-be93-064f136fee9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045212 Aug 11 16:33:12.469895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 368/771] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:12.720475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:12.721001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:12.726935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.727412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.727840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.728548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:12.728994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:12.730186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:12.862584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:12.870649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a99bc50c-47a4-4c2e-82e1-db5b2923833d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1575 microversion: 2.1 time: 0.153498 Aug 11 16:33:12.871209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 404/772] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:12 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:13.321917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:13.322462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:13.329284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.329766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.330196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.330884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.331333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.331759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.392365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:13.399691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ebf0d3b8-f6e2-4498-8dc5-699206188133 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1238 microversion: 2.1 time: 0.081742 Aug 11 16:33:13.400276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 369/773] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:13 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:13.458557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:13.459159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:13.466188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.466664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.467093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.467767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.468247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.468667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.482149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:13.484304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:13.490173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.490667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.491084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.491783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.492246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.492667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.525841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6935666a-1def-400a-b9a0-47218ad58820 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048454 Aug 11 16:33:13.526976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 370/774] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:13.610626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:13.618275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0c6762ed-da87-47d2-9c9b-fc4e610e5e89 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.163481 Aug 11 16:33:13.618838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 405/775] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:13 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:13.891317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:13.891838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:13.897759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.898241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.898671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:13.899352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:13.899800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:13.900254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.066618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:14.075302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5bfe10df-9188-4134-ba4f-899a23f31936 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1575 microversion: 2.1 time: 0.187867 Aug 11 16:33:14.075891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 371/776] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:14.420597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:14.421204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:14.427216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.427699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.428166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.428859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.429314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.429737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.490709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:14.498582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a279dd41-cc64-49db-b7bd-9826be9a356c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1294 microversion: 2.1 time: 0.081954 Aug 11 16:33:14.499147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 406/777] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:14 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:14.538700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:14.541073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:14.548311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.548898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.549404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.550165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.550689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.551184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.580822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-927754cd-47f8-440a-be8d-f01abe645eee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046174 Aug 11 16:33:14.581376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 372/778] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:14.640357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:14.640974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:14.647244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.647728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.648230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.648961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:14.649308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:14.649731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:14.794286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:14.805143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dccb1f1c-8e2b-4180-a9cd-54faa804d9c3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.168566 Aug 11 16:33:14.820310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 407/779] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:14 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:15.096663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:15.097268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:15.103063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.103545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.103976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.105253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.105687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.106114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.520467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:15.521071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:15.523533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=82 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:15.529418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.529932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.530388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.531103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.531558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.531991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.603441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:15.613747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b04d4b1-42aa-429f-a32e-d0543bcaeb57 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1300 microversion: 2.1 time: 0.096963 Aug 11 16:33:15.628361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 408/780] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:15 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:15.751217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:15.756286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:15.758963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:15.762950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c1fc8a9d-864e-4c2a-bd0d-7bf66d1aaa8a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1575 microversion: 2.1 time: 0.670045 Aug 11 16:33:15.764038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 373/781] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1575 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:15.768604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.769089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.769534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.770216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.770774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.771197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.804763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7e270671-02ce-4956-ad2b-fb2939b0de3c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189010 Aug 11 16:33:15.809778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 409/782] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:15.828825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:15.829548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:15.837843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.839349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.839896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:15.840759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:15.841298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:15.841781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.000323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:16.002731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:16.008868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.009454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.009901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.011246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.011707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.012159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.038933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'flavor' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:33:16.170689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f22ed90b-0427-42ae-a866-cc68a29dcc8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action" status: 200 len: 32 microversion: 2.1 time: 0.174455 Aug 11 16:33:16.171295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 410/783] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:33:15 2022] POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 16:33:16.181565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:16.182608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:16.191788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.192878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.193338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.194182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.194671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.195189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.246592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:16.254940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-87ef95a0-71a3-4416-b732-6799a317fe56 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1672 microversion: 2.1 time: 0.431004 Aug 11 16:33:16.255617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 374/784] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:15 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1672 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:16.344983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:16.353916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef4df8e4-e08a-449f-b4f4-c03aaf185b98 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.176655 Aug 11 16:33:16.354741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 411/785] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:16.636602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:16.637132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:16.643545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.644027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.644510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.645383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.645734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.646159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.783486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:16.784660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:16.786020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:16.793432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.794250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.794921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.796002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.796690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.797319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.799162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b174cfca-2c1e-43d9-acfd-b260de181abe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1300 microversion: 2.1 time: 0.167011 Aug 11 16:33:16.801464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 375/786] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:16 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:16.818359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:16.821354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:16.827004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:16.830142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.831069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.831747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.832708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:16.833384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:16.834045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:16.869122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f4957696-e979-44c4-b251-ab517a48ca00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055028 Aug 11 16:33:16.870861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 376/787] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:16.960435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:16.968594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8300afa-d96a-4af0-abec-1712518702ea tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1575 microversion: 2.1 time: 0.187957 Aug 11 16:33:16.969160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 412/788] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:16 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:17.278173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:17.279129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:17.285196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.285687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.286125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.287122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.287736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.288201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.377469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:17.378206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:17.385055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.385836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.386595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.387781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.388340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.388884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.535305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:17.544033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-14c3653e-3303-4032-92fa-8ab244e1f964 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.170792 Aug 11 16:33:17.556345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 413/789] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:17.743361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fca7c34-392f-431f-8ba3-191be7a54e10", "name": "network-vif-deleted", "tag": "6a27283a-4da4-4638-bff4-70f79f256e03"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:17.754948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:17.760041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.760302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.760723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.768225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c21069bd-067c-4122-b0bd-35a9f88ebf4b tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 200 len: 1604 microversion: 2.1 time: 0.493664 Aug 11 16:33:17.784169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 377/790] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:17 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:17.790963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] Creating event network-vif-deleted:6a27283a-4da4-4638-bff4-70f79f256e03 for instance 7fca7c34-392f-431f-8ba3-191be7a54e10 on hv-cinder-85220 Aug 11 16:33:17.801914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-2fec2b0f-c425-49b4-a860-d3c3d16910f7 req-a54ff18b-171c-4fd7-9bbd-a98489da00fb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062777 Aug 11 16:33:17.804272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 414/791] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:33:17.822001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:17.823095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:17.829770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.830653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.831620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.832557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.833345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.833831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.883657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:17.885988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:17.892611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.893099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.893539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.894242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.894872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:17.895508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:17.927044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fa91b697-99eb-4897-977b-6d6cef79d124 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047666 Aug 11 16:33:17.928136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 415/792] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:17.990792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:17.991707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:17.998824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:17.999606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.000304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.001390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.002173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.002812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.089907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:18.098226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8a4a9d2-36f0-471b-8006-5d898d0b066f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1508 microversion: 2.1 time: 0.111360 Aug 11 16:33:18.100001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 416/793] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1508 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:18.407012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:18.418584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4c3e285f-4383-46ee-91db-ce0788beb63e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.601017 Aug 11 16:33:18.419678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 378/794] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:17 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:18.570017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:18.571062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:18.585308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.587096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.588196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.592294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.593153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.594626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.797722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:18.800432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:18.812595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.814208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.815602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.817109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.818268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.818817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.835508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 HTTP/1.1 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:33:18.837368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:33:18.839806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '7fca7c34-392f-431f-8ba3-191be7a54e10'} Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:33:18.842740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:33:18.844037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:33:18.846645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:33:18.847758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-69c04fa6-a986-4f82-aa11-315e8436d660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 404 len: 111 microversion: 2.1 time: 0.058100 Aug 11 16:33:18.850064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 379/795] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:18 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:33:18.858754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a357ffa3-2bc7-4517-9b25-79200bae61da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '.version_select at 0x7f6143c4f9d0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:18.860223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:18.873924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c61c7126-73aa-4edf-ac06-cd6aea9ea2a9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.310131 Aug 11 16:33:18.875181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 417/796] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:18.888815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a357ffa3-2bc7-4517-9b25-79200bae61da tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722919124" status: 202 len: 0 microversion: 2.1 time: 0.033952 Aug 11 16:33:18.889665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 380/797] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Aug 11 16:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722919124 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 16:33:18.939499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:18.942402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:18.952345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.957620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.958282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:18.959381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:18.959984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:18.962553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.000329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7fe36b03-5e49-480c-bd47-9a3216efa8c6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064739 Aug 11 16:33:19.001444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 418/798] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:19.124050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:19.125063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:19.137065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.137797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.138453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.139335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.139945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.140733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.148418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:33:19.148855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 (ip 10.222.0.43) !!! Aug 11 16:33:19.290648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:19.300779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5058407e-689f-4d5e-929b-c36fbd03c884 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.182563 Aug 11 16:33:19.312886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 381/799] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:19 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:19.504024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:19.504963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:19.517384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.518158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.518796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.519545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.520296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.520899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.669131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:19.677757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84a3f73d-32c9-4e54-b260-4c851a739b52 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.239938 Aug 11 16:33:19.679125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 419/800] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:19 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:19.824301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e2fbc-243f-414d-a640-f814f64e7947", "name": "network-vif-deleted", "tag": "5a8308f7-463f-4fc0-b4bb-809bb832b03f"}, {"name": "network-changed", "server_uuid": "364a5b7f-5bb8-405e-a07a-6256f38a1b38", "tag": "86f53121-5a7e-4481-9414-02491e39e779"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:19.835014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.835580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.836018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.848961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Creating event network-vif-deleted:5a8308f7-463f-4fc0-b4bb-809bb832b03f for instance b79e2fbc-243f-414d-a640-f814f64e7947 on hv-cinder-85220 Aug 11 16:33:19.849467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] Creating event network-changed:86f53121-5a7e-4481-9414-02491e39e779 for instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 on hv-cinder-85220 Aug 11 16:33:19.856429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-d7e4aa1d-09bb-4822-a32d-73a906d30d3c req-ed5e5f7f-a77b-4acd-9069-f508e8393146 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036303 Aug 11 16:33:19.857020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 382/801] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:33:19.896678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:19.897290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:19.904358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.904869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.905301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:19.905983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:19.906431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:19.906846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.014272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:20.016835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:20.024311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.024793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.025398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.027043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.027818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.028288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.032480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:20.040422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:20.051932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7cf2cf5e-b62a-4ef7-82f1-753c2fc7ed1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.159052 Aug 11 16:33:20.068989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 420/802] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:20.085666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8addf032-570b-4f60-bfe7-f38ec5b887e7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'create', calling method: .version_select at 0x7f614350d700>, body: {"keypair": {"name": "tempest-keypair-988576629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLWs8nzN+Jf/TtCusbg+Qvm00r3lx45LyJrObGRIywlNvwtUdyrnbsUA5VWHkhjF5gx4GeWPAaNRpmk1PNl4yilCmi/1tqhGAFZZ78SH/L7kxIwWzW57A4Zr7UDKzvMg=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:20.090877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b486b613-cde3-4d24-af10-2b7adcf48c4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081610 Aug 11 16:33:20.091442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 383/803] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:20.102823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-8addf032-570b-4f60-bfe7-f38ec5b887e7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for project 6d15983e6d8e4ad6887105f88f187044. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:33:20.107405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-8addf032-570b-4f60-bfe7-f38ec5b887e7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for user 3a5ab962b58f473f874bd94bfe2db6b3 and project 6d15983e6d8e4ad6887105f88f187044. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:33:20.128636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8addf032-570b-4f60-bfe7-f38ec5b887e7 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048183 Aug 11 16:33:20.129230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 421/804] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:33:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:33:20.323410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:20.323956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:20.326039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:20.332764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.333386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.333884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.334643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.335150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.335792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.414129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:20.425613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-209219bc-26ff-4466-9289-78e6c8753b7e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.106630 Aug 11 16:33:20.426191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 384/805] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:20.701817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:20.702429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:20.709025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.709515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.709951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.710646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:20.711100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:20.711557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:20.849329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:20.857646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b3b65e23-8252-49dc-8ab6-6ce0fe86fbde tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.160670 Aug 11 16:33:20.858222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 422/806] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:20 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:21.079704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:21.080433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:21.086808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.087293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.087728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.089115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.089767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.090227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.103675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:21.106561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:21.113163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.113742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.114231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.115004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.115522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.116308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.155020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e9b9f1e1-d283-4e90-b1f5-befa86a6b9a8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055438 Aug 11 16:33:21.155510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 423/807] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:21.446913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:21.447433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:21.454344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.454832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.455270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.455963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.456444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.456890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.518025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:21.525610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b68de713-37a8-4ee4-96ed-6bfc82c2513e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082648 Aug 11 16:33:21.526596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 424/808] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:21.572518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:21.581340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a7aa7fe-8df4-4a9d-b571-2204fae62906 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.505538 Aug 11 16:33:21.581903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 385/809] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:21.788533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1770301164", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97b922f2-8007-4606-ab93-3e8f9ba65cd9"}], "security_groups": [{"name": "tempest-securitygroup--513569366"}], "key_name": "tempest-keypair-988576629", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:21.879222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:21.880074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:21.886671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.887151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.887580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.888295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:21.888743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:21.889158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:21.892139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] validate_networks() for [('97b922f2-8007-4606-ab93-3e8f9ba65cd9', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:33:22.106112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:22.113838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bcd80cfe-c429-4cc0-9568-06c295a30bbe tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.238784 Aug 11 16:33:22.121300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 386/810] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:21 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:22.167596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:22.170245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:22.176800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.177373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.177881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.178648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.179222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.179713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.208797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b78c81b2-147a-458b-95a9-4381eaf5374f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Aug 11 16:33:22.209485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 387/811] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:22.310249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:33:22.310746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:33:22.311123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:33:22.311528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:33:22.311939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:33:22.320653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.321129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.321552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.322270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.322742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.323756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.339810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for project 6d15983e6d8e4ad6887105f88f187044. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:33:22.343715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Getting quotas for user 3a5ab962b58f473f874bd94bfe2db6b3 and project 6d15983e6d8e4ad6887105f88f187044. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:33:22.354497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:33:22.356708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:33:22.401929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6969bffa-c630-4649-8c41-785ce71070e1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617633 Aug 11 16:33:22.402567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 425/812] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:33:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 16:33:22.413109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eeb67d25-e22d-473b-a6d2-e6cc3219cfc1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:22.413714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eeb67d25-e22d-473b-a6d2-e6cc3219cfc1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:22.467306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eeb67d25-e22d-473b-a6d2-e6cc3219cfc1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:22.473981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eeb67d25-e22d-473b-a6d2-e6cc3219cfc1 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1237 microversion: 2.1 time: 0.064618 Aug 11 16:33:22.474517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 388/813] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:22 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:22.547140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:22.547747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:22.553743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.554332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.554765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.555445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.555892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.556397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.602518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:22.603133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:22.610516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.611105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.611645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.612474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:22.613021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:22.613536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:22.626667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:22.634063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-103d0299-dfed-4193-8910-1e4aaec340d6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.090995 Aug 11 16:33:22.644235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 426/814] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:22.767983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:22.776882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-596becae-3081-49ac-bb9a-a58145134d9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.177424 Aug 11 16:33:22.777856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 389/815] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:23.135368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:23.136055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:23.143116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.143325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.143753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.144458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.144902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.145315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.222468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:23.224859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:23.232946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.233379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.233945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.234714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.235361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.235719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.266597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ea29964b-64ed-49ad-85e9-1de48a93f3a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048243 Aug 11 16:33:23.267163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 390/816] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:23.276975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:23.284273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa579780-53bc-457f-8219-1e5167e60bd1 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.152885 Aug 11 16:33:23.284828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 427/817] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:23 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:23.494546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:23.495839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:23.501709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.502188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.502616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.503307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.503781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.504404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.583078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:23.591129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0f72ed0e-4599-49e0-bdf2-60bce50b39b4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1307 microversion: 2.1 time: 0.100596 Aug 11 16:33:23.591693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 391/818] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:23 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:23.654877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:23.655494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:23.661569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.662047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.662487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.663172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.663622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.664405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.727296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:23.734901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72968768-359b-4c68-9e9e-09681f367b90 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084184 Aug 11 16:33:23.735456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 428/819] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:23 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:23.798799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:23.799431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:23.805743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.806235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.806673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:23.808074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:23.809064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:23.809499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.006626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:24.020490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4d26ba57-2b27-4c9d-b49c-6c9041357ab9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.225059 Aug 11 16:33:24.034945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 392/820] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:24.279854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:24.282207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:24.295995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.296450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.296893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.297602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.298057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.298480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.306000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:24.307362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:24.315659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.316401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.317102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.317998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.318649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.319374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.361325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-61d5c5f3-88ad-4970-bcbd-25bfd9dfffd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085460 Aug 11 16:33:24.362599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 429/821] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:24.569810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:24.577900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ade0ce7-e80d-4915-8f8e-76edd8216345 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.276334 Aug 11 16:33:24.578467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 393/822] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:24 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:24.611313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:24.611918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:24.617797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.618269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.618694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.619371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.620493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.620985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.758277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:24.759072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:24.759211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:24.766905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.767526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d93a4bec-7412-442d-9b38-78c4ea97881e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.159962 Aug 11 16:33:24.767650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.768223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.768783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 430/823] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:24 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:24.769228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:24.769778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:24.770290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:24.878999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:24.888009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc3202d4-7710-429f-a131-00ddc100b985 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.135563 Aug 11 16:33:24.888703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 394/824] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:24 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:25.014726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cf20b4-6343-405c-a68c-4d92de212cc1", "tag": "75169d22-cc9d-4a7c-bda1-cb6a9c81881d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:25.025477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.027003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.027603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.039949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] Creating event network-changed:75169d22-cc9d-4a7c-bda1-cb6a9c81881d for instance 76cf20b4-6343-405c-a68c-4d92de212cc1 on hv-cinder-85220 Aug 11 16:33:25.042522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:25.044052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:25.045419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-49c59df5-af10-4b7a-a1ac-37a4b57e06f1 req-1dd8d173-7310-451a-8bdd-819f18f61f7d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044064 Aug 11 16:33:25.046345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 431/825] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:33:25.050972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.051422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.051841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.052579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.053032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.053623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.260053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:25.268838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-62ea9113-0835-4661-8e30-5780810bba9e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.230683 Aug 11 16:33:25.269414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 395/826] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:25.375586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:25.377799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:25.383823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.384331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.384758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.386024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.386471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.386885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.391335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:25.415882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-208932eb-3279-4998-baa2-910c4f2db22b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045087 Aug 11 16:33:25.416474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 432/827] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:25.599352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:25.600140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:25.607454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.607936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.608410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.609101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.609717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.610082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.742010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:25.750389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eacb6a8a-b50e-4cb5-8cd8-3905988c11bd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.154920 Aug 11 16:33:25.750964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 396/828] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:25 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:25.788236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:25.788954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:25.795043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.795596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.796032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.796739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.797185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.797598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.909884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:25.910814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:25.917211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.917711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.918152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.918860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.919342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.920121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.933899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:25.942231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4006e9c5-dd23-47b2-aed6-2da4923440ee tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.157651 Aug 11 16:33:25.943175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 433/829] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:25 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:25.948360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364a5b7f-5bb8-405e-a07a-6256f38a1b38", "name": "network-vif-plugged", "status": "completed", "tag": "86f53121-5a7e-4481-9414-02491e39e779"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:25.960116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:25.960736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:25.961295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:25.973897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] Creating event network-vif-plugged:86f53121-5a7e-4481-9414-02491e39e779 for instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 on hv-cinder-85220 Aug 11 16:33:25.978856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-d4b91d8b-8185-4cd9-9311-231d12399b75 req-21bb3cb0-0c5c-4586-86f4-d89b76fe258d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034377 Aug 11 16:33:25.980157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 434/830] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:33:25.989131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:25.997308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b0f38559-c679-4f9f-bd04-aa05e67b649e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.091540 Aug 11 16:33:25.997959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 397/831] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:26.291146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:26.291909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:26.298252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.298731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.299162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.299847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.300330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.300753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.428931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:26.431841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:26.434060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:26.439935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.440611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.441117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.442136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b52a8116-ca44-4e26-b12e-2256c970e017 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.155315 Aug 11 16:33:26.442562 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.443008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 435/832] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:26.443127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.443583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.476821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9ba21891-f78e-4042-b578-726a09e4c08c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052419 Aug 11 16:33:26.477610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 398/833] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:26.771763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:26.772408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:26.778828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.779309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.779743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.780476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.780925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.781347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.912123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:26.919788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-952fdfb8-d32a-4a1c-a871-8e8019e9a5dc tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.151844 Aug 11 16:33:26.920378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 436/834] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:26 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:26.962618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:26.963258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:26.970430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.970913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.971353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:26.972069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:26.972630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:26.973061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.017681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:27.018296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:27.024399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.024887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.025327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.026802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.027271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.027697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.090545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:27.098029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a09ff9ec-4347-4482-9cce-a3648440537d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084161 Aug 11 16:33:27.098940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 437/835] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:27 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:27.193694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:27.201839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6b6575e8-9635-4a00-8d71-e05830fcd7d3 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.243045 Aug 11 16:33:27.202406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 399/836] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:26 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:27.462333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:27.462867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:27.470247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.470723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.471174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.471857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.472340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.472759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.489560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:27.491784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:27.498390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.498896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.499331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.500028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.500570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.500929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.528192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:27.533687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4728d348-14f9-4daf-ab77-5676da5de98d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048035 Aug 11 16:33:27.534263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 400/837] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:27.609213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:27.617304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f16c56d-f585-4722-9bb9-602da312a59a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.158943 Aug 11 16:33:27.617872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 438/838] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:27.941839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:27.942458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:27.949142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.949622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.950057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:27.950744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:27.951199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:27.951621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.080913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:28.088899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-076b2749-ad10-4270-ba3a-f50ea28d38a9 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1368 microversion: 2.1 time: 0.150286 Aug 11 16:33:28.089657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 401/839] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:27 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:28.118736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:28.119340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:28.125904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.126361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.126786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.127461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.127911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.128349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.189844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:28.199003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d80c9a02-ffaf-4703-a6e8-b678eac472c8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084114 Aug 11 16:33:28.199506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 439/840] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:28.222034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:28.222647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:28.228606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.229830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.230276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.230963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.231418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.231845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.369160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:28.377423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-17526567-e532-41f7-942d-9f3fdf887b2f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.159109 Aug 11 16:33:28.377995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 402/841] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:28 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:28.546342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:28.548516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:28.555687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.556238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.556668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.557432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.557905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.558326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.591280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7d70d16b-1a04-4af2-9ed4-3d9c091fbf2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049107 Aug 11 16:33:28.591994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 440/842] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:28.639118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:28.639722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:28.645609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.646083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.646514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.647218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:28.647664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:28.648082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:28.775423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:28.783800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dea21347-d6ff-4970-aa78-7944ab9c1d16 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.148456 Aug 11 16:33:28.784395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 403/843] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:29.109927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.110541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.116959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.117437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.117869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.118549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.118999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.120055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.218744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.219360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.225825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.226312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.226755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.227448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.227898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.228348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.249697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:29.257538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f44df47c-2018-4019-8ade-57534c73d3b2 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1559 microversion: 2.1 time: 0.151377 Aug 11 16:33:29.258148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 441/844] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:29.280348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.281092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.287039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.287522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.287960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.288687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.289150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.289581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.293697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:29.301158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-89da5ff1-a428-4834-b3db-67fafe85ba9d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086229 Aug 11 16:33:29.301723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 404/845] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:29.368204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e927b30c-251b-49f7-804b-efa358015604 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092101 Aug 11 16:33:29.368796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 442/846] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:33:29.397930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.398580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.404718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.405202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.405648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.406320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.406769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.407200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.540854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:29.549045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bf439b19-6803-4f15-8d71-b2a864f5b40f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.154975 Aug 11 16:33:29.549620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 405/847] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:29.603052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.606043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.612212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.612803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.613313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.614084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.614634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.615135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.644403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06dd8127-f1f3-4668-9dd2-b85fa9b2c97c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045373 Aug 11 16:33:29.644982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 443/848] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:29.811607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:29.812249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:29.821737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.822226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.822759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.823543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:29.823991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:29.824570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:29.965186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:29.973821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-19396eaf-a3e3-4903-a59d-ac247cf0bb70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.166261 Aug 11 16:33:29.987693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 406/849] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:30.325467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:30.326354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:30.333474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.333759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.334313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.335113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.335668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.362670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364a5b7f-5bb8-405e-a07a-6256f38a1b38", "tag": "86f53121-5a7e-4481-9414-02491e39e779"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:30.374249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.374721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.375146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.387527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] Creating event network-changed:86f53121-5a7e-4481-9414-02491e39e779 for instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 on hv-cinder-85220 Aug 11 16:33:30.393097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-f73be007-1a40-43a8-8385-57d41c8e0a35 req-ce81d0bb-fe7d-469c-aacd-4e70b651f40f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033952 Aug 11 16:33:30.393896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 407/850] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:33:30.409741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:30.416581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3af28d7a-411f-4f6e-8b01-e228bb8095fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.096626 Aug 11 16:33:30.417458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 444/851] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:30 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:30.570354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:30.571040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:30.577248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.577724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.578150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.578833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.579277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.579694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.657232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:30.659435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:30.661449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:30.671150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.671930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.672651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.673509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:30.674122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:30.674556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:30.706453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e26005d-65f7-494a-8e9b-4ad86fd5e197 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053305 Aug 11 16:33:30.707274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 445/852] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:30.721193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:30.729062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac16de3d-7788-4c05-bad9-5a66e35669f9 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.162666 Aug 11 16:33:30.729651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 408/853] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:30 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:30.995876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:30.996779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:31.003018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.003503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.003932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.004657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.005106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.005524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.372430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:31.380843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f46938d-8f6e-4aeb-942d-82e99374b2e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.389819 Aug 11 16:33:31.381525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 446/854] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:31.438283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:31.438899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:31.445586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.446074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.446680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.447659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.448616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.449040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.515001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:31.522574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-66eadd96-3b38-4f50-92eb-9f1a6e3f7e58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088171 Aug 11 16:33:31.523147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 409/855] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:31.719604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:31.721843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:31.728375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.729530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.730102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.731109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.731872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.732333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.753122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:31.755146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:31.765634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.766301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.766834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.767643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.768434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.769714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.773770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d03da0a-7122-4e5a-8ed6-94b5aedb35b2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058366 Aug 11 16:33:31.778769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 447/856] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:31.917460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:31.925081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3881d91a-7885-4110-a63f-f4b7e8875a13 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.178879 Aug 11 16:33:31.925647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 410/857] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:31 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:31.953750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cf20b4-6343-405c-a68c-4d92de212cc1", "name": "network-vif-plugged", "status": "completed", "tag": "75169d22-cc9d-4a7c-bda1-cb6a9c81881d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:31.964164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:31.965216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:31.965643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:31.977123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] Creating event network-vif-plugged:75169d22-cc9d-4a7c-bda1-cb6a9c81881d for instance 76cf20b4-6343-405c-a68c-4d92de212cc1 on hv-cinder-85220 Aug 11 16:33:31.982545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-c98b47a9-bbd2-4751-806e-7d3ac48bc3bc req-96f85501-cddc-471e-ad63-f0013c8fe8b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Aug 11 16:33:31.983365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 448/858] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:33:32.404353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:32.404976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:32.410853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.411327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.411756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.412465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.412909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.413323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.471204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:32.543956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:32.544761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:32.545005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:32.547231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:32.548088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=10 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:32.553018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-22210fb2-3ad3-4dbe-88f1-6c44224038e4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1713 microversion: 2.1 time: 0.152562 Aug 11 16:33:32.553641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 411/859] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:33:32.554861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.555352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.555789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.556540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.557672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.558298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.612632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:32.613122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:32.619007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.619533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.620491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.621181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.621627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.622459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.625519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:32.632964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-634c1cbb-11e8-4d39-ab47-e91bf411f2c3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.093887 Aug 11 16:33:32.633533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 449/860] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:32.786055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:32.788262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:32.794878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.795357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.795878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.796596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.797038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.797455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.811015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:32.827078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8aff9d3c-1525-498c-8fba-f5c99c4cbed4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045045 Aug 11 16:33:32.827730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 450/861] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:32.946197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:32.946734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:32.953296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.953781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.954248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:32.954963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:32.955483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:32.956078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:33.084124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:33.091595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8f3a275-ac41-4979-8bed-a961e0d55e39 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1362 microversion: 2.1 time: 0.149222 Aug 11 16:33:33.092188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 451/862] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:32 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:33.653832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:33.654476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:33.660904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:33.661380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:33.661809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:33.662484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:33.662931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:33.663345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:33.724390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:33.733208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b7d6717-f856-470c-81fb-19a1624a83c4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083803 Aug 11 16:33:33.733769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 452/863] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:33 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:33.839823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:33.842017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:33.848357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:33.849110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:33.849730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:33.850695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:33.851159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:33.851600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:33.882811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ca77d28-f3ce-4337-b470-c1340901e77a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047101 Aug 11 16:33:33.883369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 453/864] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:34.112888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:34.113491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:34.119353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.120571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.120992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.121663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.122110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.122523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.248949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:34.256342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6ca17f4-10c1-431d-9708-f9eb2cf3812f tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1548 microversion: 2.1 time: 0.147241 Aug 11 16:33:34.256896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 454/865] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:34 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:34.277393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:34.277880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:34.283567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.284043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.284507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.285186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.285636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.286060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.365596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82b9080e-b122-4254-86b5-d55f5d90e741 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092745 Aug 11 16:33:34.366184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 455/866] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:33:34 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:33:34.754953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:34.755840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:34.762475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.762968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.763404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.764122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.764592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.765017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.855448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:34.862989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e35fc555-dc1a-425d-8b19-fbe409aaa428 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.112413 Aug 11 16:33:34.863566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 456/867] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:34 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:34.894918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:34.897090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:34.903497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.903979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.904435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.905123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:34.905660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:34.906144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:34.936040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-62a9d633-bb9a-4cb1-a37f-2a276edccc8c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Aug 11 16:33:34.936549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 457/868] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:35.369220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cf20b4-6343-405c-a68c-4d92de212cc1", "tag": "75169d22-cc9d-4a7c-bda1-cb6a9c81881d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:33:35.379193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:35.379662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:35.380083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:35.391065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] Creating event network-changed:75169d22-cc9d-4a7c-bda1-cb6a9c81881d for instance 76cf20b4-6343-405c-a68c-4d92de212cc1 on hv-cinder-85220 Aug 11 16:33:35.395742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-c4dbf1db-7ffa-42f6-8484-33c85533506c req-7bb77035-0360-4908-9be3-d6cf908a82bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083814 Aug 11 16:33:35.396355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 458/869] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:33:35.885850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:35.886553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:35.893833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:35.894326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:35.894766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:35.895463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:35.896092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:35.896541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:35.961395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:35.969983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4f1d5d4-1b7e-4daa-ad64-50cf00dc95f6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.089425 Aug 11 16:33:35.970781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 459/870] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:35 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:35.985082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:35.987411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:35.993822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:35.994328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:35.995271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:35.995965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:35.996454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:35.996902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:36.029096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d3bf8c8-ba93-45fd-b159-402d89518cdf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056295 Aug 11 16:33:36.029782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 460/871] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:36.991282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:36.991940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:36.998918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:36.999391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:36.999815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:37.000515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:37.000963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:37.001379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:37.062430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:37.069929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0901044f-24e0-4635-8ce8-c35f6fcf3f6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082499 Aug 11 16:33:37.070479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 461/872] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:36 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:37.074952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:37.077095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:37.082576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:37.083051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:37.083483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:37.084183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:37.084630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:37.085045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:37.113424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab0c40a3-69ea-40fb-a9f6-ff904c7bccbf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Aug 11 16:33:37.113961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 462/873] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:38.091096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:38.091702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:38.098137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:38.098613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:38.099039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:38.099714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:38.100190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:38.100610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:38.161871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:38.169989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f2c91f3e-537b-4c93-8808-1c7f0e24fa0d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083380 Aug 11 16:33:38.170550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 463/874] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:38 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:38.174972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:38.177080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:38.182866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:38.183338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:38.184034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:38.184733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:38.185182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:38.185599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:38.214781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e87966e8-851d-4e9a-b82e-21d1a203e7e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043235 Aug 11 16:33:38.215341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 464/875] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:39.190492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:39.191112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:39.198106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:39.198598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:39.199062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:39.199750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:39.200235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:39.200656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:39.267888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:39.275397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-098f824f-8683-4345-a483-c4d6354f652f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088894 Aug 11 16:33:39.275949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 465/876] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:39 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:39.288209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:39.288209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:39.288209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:39.288497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:39.288819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:39.289490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:39.289935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:39.290353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:39.319666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9dbaa3a0-cddb-4aa8-ab5c-45856d1cb40d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042710 Aug 11 16:33:39.320222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 466/877] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:40.294810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:40.295445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:40.302041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:40.302516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:40.302943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:40.303668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:40.304122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:40.304561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:40.365857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:40.373853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-deaf2add-f60e-4e14-940e-483d6ec0f157 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083014 Aug 11 16:33:40.374417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 467/878] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:40 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:40.378901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:40.380997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:40.387392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:40.387861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:40.388347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:40.389001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:40.389443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:40.389857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:40.393512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:40.418844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b1f41f3-e5c3-4137-9863-34d7b95335f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043435 Aug 11 16:33:40.419395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 468/879] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:41.394771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:41.395403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:41.402391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:41.402884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:41.403322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:41.404018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:41.404504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:41.404932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:41.467517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:41.475098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4b58947-5f4a-4b26-8a47-34f554501148 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084159 Aug 11 16:33:41.475662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 469/880] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:41 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:41.480770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:41.482950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:41.488813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:41.489298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:41.489757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:41.490450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:41.490896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:41.491314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:41.520968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0ac80ada-cdb7-42dd-bbab-fa16de2f22c5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044288 Aug 11 16:33:41.521513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 470/881] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:42.496329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:42.496957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:42.503348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:42.503825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:42.504295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:42.504973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:42.505416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:42.505829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:42.566163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:42.573702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aaaaa157-0f3c-4f98-b6ef-5873d1a571ac tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081462 Aug 11 16:33:42.574263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 471/882] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:42 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:42.578725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:42.580847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:42.586382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:42.586863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:42.587292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:42.588511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:42.588989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:42.589409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:42.617126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=59 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:42.618168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-475339ce-6aea-45b9-988a-3bf955533734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042842 Aug 11 16:33:42.618853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 472/883] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:42.640246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=67 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:43.594048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:43.594664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:43.601244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:43.601720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:43.602162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:43.602848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:43.603300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:43.603883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:43.666597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:43.674042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a06b6935-ef7a-45e9-b611-128b2a486e15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083896 Aug 11 16:33:43.674593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 473/884] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:43 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:43.679009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:43.681114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:43.687197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:43.687672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:43.688114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:43.688795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:43.689240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:43.689654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:43.867498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7858846d-1e20-4335-bd6b-ba0a69b08c49 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191801 Aug 11 16:33:43.867962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 474/885] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:44.694691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:44.695332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:44.701824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:44.702297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:44.702723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:44.703399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:44.703841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:44.704287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:44.768740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:44.776078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c109ec7c-2e1e-4f0a-8dad-39889a3e86ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085247 Aug 11 16:33:44.776639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 475/886] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:44 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:44.880062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:44.882197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:44.888644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:44.889125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:44.889563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:44.890250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:44.890701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:44.891125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:44.919180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9f4da5b-43c3-4f2b-93b1-91af18c221aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042938 Aug 11 16:33:44.919716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 476/887] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:45.795723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:45.796379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:45.802721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:45.803202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:45.803638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:45.804362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:45.804818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:45.805243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:45.865713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:45.873295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a2f60a5-db57-4a6a-b8c4-ba4c34eb6833 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081709 Aug 11 16:33:45.873848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 477/888] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:45 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:45.930899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:45.933375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:45.939375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:45.939856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:45.940328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:45.941014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:45.941468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:45.941893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:45.971431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bbd8fa9d-d917-4851-9e12-2a277c2de460 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 Aug 11 16:33:45.971970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 478/889] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:46.894268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:46.894886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:46.901948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:46.902429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:46.902862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:46.903553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:46.904007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:46.904458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:46.965062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:46.972510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72d68cdd-c13e-4717-bc4e-5989f1cd08fe tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082158 Aug 11 16:33:46.973063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 479/890] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:46 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:46.984262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:46.986361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:46.991949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:46.992467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:46.992902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:46.993585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:46.994037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:46.994461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:47.023838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d18cc1f1-6840-4c17-8529-68ba4cc9962a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043194 Aug 11 16:33:47.024409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 480/891] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:33:47.993785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:47.994640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:48.000773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:48.001249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:48.001673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:48.002354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:48.002797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:48.003212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:48.064017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:48.071585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2551274-58bd-4c61-9ada-f333baf65218 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081654 Aug 11 16:33:48.072149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 481/892] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:47 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:48.077112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:48.079194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:48.084954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:48.085429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:48.085858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:48.086541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:48.086987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:48.087404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:48.116507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ecc021ed-daed-4375-b376-b35306aad64d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042855 Aug 11 16:33:48.117050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 482/893] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:49.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:49.094635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:49.100948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:49.101423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:49.101849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:49.102524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:49.102970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:49.103385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:49.169642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:49.177181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f2a0d38-cb0f-431d-90f5-5099ce468f5b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087080 Aug 11 16:33:49.177734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 483/894] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:49 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:49.182225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:49.184825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:49.190389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:49.190868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:49.191300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:49.191986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:49.192460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:49.192882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:49.217595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:49.222478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6531116a-77bc-4fb1-82fa-68c839b749fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Aug 11 16:33:49.223020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 484/895] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:50.198567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:50.199182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:50.205642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:50.206125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:50.206556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:50.207245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:50.207701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:50.208147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:50.269830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:50.277431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eccf0a8b-9dd1-4ad0-8652-771343f7b6b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083019 Aug 11 16:33:50.277990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 485/896] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:50 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:50.282537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:50.284714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:50.290679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:50.291581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:50.292248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:50.292906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:50.293348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:50.293765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:50.323199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b80b0ac3-4488-497e-8638-5d809d4a81be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044124 Aug 11 16:33:50.323660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 486/897] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:51.298574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:51.299193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:51.305607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:51.306085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:51.306584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:51.307872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:51.308346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:51.309028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:51.368476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:51.376513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d2911d2-d565-4db0-8f7d-5391b727a901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081870 Aug 11 16:33:51.377066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 487/898] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:51 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:51.381526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:51.383631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:51.389532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:51.390011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:51.390439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:51.391131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:51.391576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:51.391992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:51.422403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2cae7a0e-cb6e-4ba4-b7b1-badc04c78988 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044348 Aug 11 16:33:51.422939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 488/899] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:52.397837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:52.398480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:52.404783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:52.405258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:52.405685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:52.406360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:52.406805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:52.407222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:52.467859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:52.475247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d39d6f96-ae8e-4de1-af32-f266d0916768 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081378 Aug 11 16:33:52.475800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 489/900] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:52 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:52.480322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:52.482397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:52.487989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:52.488495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:52.488921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:52.489598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:52.490039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:52.490455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:52.519264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-764948c7-2fab-495d-b683-b855e6bca9f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 Aug 11 16:33:52.519798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 490/901] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:53.497886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:53.498536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:53.505022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:53.505505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:53.505939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:53.506621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:53.507070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:53.507491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:53.571601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:53.579411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c9b53167-98e6-42c1-b39f-5eec23a7aaba tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086073 Aug 11 16:33:53.579963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 491/902] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:53 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:53.584489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:53.586598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:53.592353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:53.592829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:53.593258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:53.593945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:53.594395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:53.594818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:53.623988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5cc0a40-c8b9-4db3-bfc7-e41cabe036b5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043005 Aug 11 16:33:53.624572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 492/903] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:54.599844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:54.600541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:54.606943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:54.607421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:54.607854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:54.608579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:54.609030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:54.609456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:54.669287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:54.676736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0dccbc34-0df4-43e6-a3dd-96e646fa9328 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.080739 Aug 11 16:33:54.677301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 493/904] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:54 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:54.682411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:54.684784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:54.690307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:54.690784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:54.691215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:54.691897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:54.692373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:54.692791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:54.721395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46accb5d-3026-4c01-9b55-2ed45162a007 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043098 Aug 11 16:33:54.721939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 494/905] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:55.698979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:55.700328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:55.702846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:55.708016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:55.708521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:55.708951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:55.709644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:55.710091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:55.710508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:55.770888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:55.779006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9360c3af-68d6-4f54-8188-5e2b7bc4748a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084677 Aug 11 16:33:55.779563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 495/906] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:55 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:55.788739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:55.788739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:55.792022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:55.792549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:55.792986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:55.793679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:55.794134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:55.794561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:55.824637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b6f1434-4933-470d-bba8-d818b0b8a691 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044087 Aug 11 16:33:55.825180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 496/907] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:56.800430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:56.801095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:56.807414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:56.807889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:56.808347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:56.809299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:56.809748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:56.810172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:56.870209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:56.877682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1fe8657f-20e8-4ce2-abee-462465b8315b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081166 Aug 11 16:33:56.878239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 497/908] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:56 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:56.882687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:56.884861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:56.890387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:56.890867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:56.891299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:56.891982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:56.892460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:56.892880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:56.921649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c4af08b4-cf68-405c-9ccf-2e1870a1e8ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042425 Aug 11 16:33:56.922190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 498/909] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:57.898306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:57.899001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:57.905149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:57.905637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:57.906068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:57.906750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:57.907200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:57.907622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:57.973153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:57.980634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70c8b8e6-40c4-449a-86fc-7c817258c199 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086328 Aug 11 16:33:57.981190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 499/910] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:57 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:57.985673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:57.987781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:57.993306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:57.993786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:57.994230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:57.994911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:57.995356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:57.995777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:58.024084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36657eec-0ad9-4b74-8859-1a0aef5bfebe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041916 Aug 11 16:33:58.024644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 500/911] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:33:59.001044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:59.001675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:59.008017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:59.008555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:59.008999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:59.010321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:59.010780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:59.011206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:59.025643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:33:59.074520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:33:59.082178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a48a2a4b-4b52-418e-b3df-2cd0f08a3cd1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085119 Aug 11 16:33:59.082738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 501/912] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:33:58 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:33:59.087341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:33:59.089699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:33:59.095240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:59.095720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:59.096194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:59.096892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:33:59.097344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:33:59.097772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:33:59.126390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-506bf304-9054-4c67-a36d-349fbb9851f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 Aug 11 16:33:59.126927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 502/913] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:33:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:00.102656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:00.103770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:00.110221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:00.110704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:00.111136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:00.111816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:00.112292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:00.112708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:00.173555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:00.181016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55f5fdb1-2d73-4dfe-96b6-1603ac404962 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082229 Aug 11 16:34:00.182236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 503/914] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:00 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:00.186999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:00.189173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:00.194780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:00.195265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:00.195700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:00.196422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:00.196880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:00.197390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:00.225332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-34bba8c7-8ff6-4f96-9d98-4356e0e6101c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042129 Aug 11 16:34:00.225874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 504/915] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:01.202314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:01.202974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:01.209480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:01.209971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:01.210405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:01.211101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:01.211559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:01.211992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:01.273732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:01.281977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6396f85-2bb2-4c8f-ba8f-689a70ef92a7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083516 Aug 11 16:34:01.282543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 505/916] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:01 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:01.287258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:01.289691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:01.296374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:01.296859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:01.297295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:01.297985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:01.298439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:01.298871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:01.327494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59775939-55ab-4c64-ac1d-3aa3519ed256 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Aug 11 16:34:01.327969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 506/917] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:02.303130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:02.303770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:02.312551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:02.313043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:02.313480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:02.314182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:02.314637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:02.315070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:02.380193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:02.387958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0db8485c-8a6c-479c-aaa8-a1c43c4b73f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088654 Aug 11 16:34:02.388551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 507/918] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:02 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:34:02.393202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:02.395307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:02.401040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:02.401520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:02.401955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:02.402645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:02.403128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:02.403552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:02.433053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28569310-8882-4113-b10b-388973edfba7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043491 Aug 11 16:34:02.434854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 508/919] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:03.408925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:03.409561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:03.415997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:03.416514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:03.416937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:03.417617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:03.418063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:03.418478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:03.479201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:03.486582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f1b9d2d-5297-4842-be5a-0f88c6954681 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081579 Aug 11 16:34:03.487137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 509/920] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:03 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:03.491719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:03.495312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:03.501070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:03.501550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:03.501986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:03.502675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:03.503125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:03.503546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:03.532370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72c80dd3-a2d6-49be-8499-3d2459feeec3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Aug 11 16:34:03.532912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 510/921] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:04.507553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:04.508233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:04.515522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:04.516002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:04.516468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:04.517151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:04.517599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:04.518039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:04.578418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:04.585857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37c45aec-4a23-4c3c-9aa7-8e0544313eee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082140 Aug 11 16:34:04.586437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 511/922] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:04 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:04.590920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:04.593055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:04.599180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:04.599673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:04.600127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:04.600836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:04.601283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:04.601719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:04.635251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3b9ace8-9c51-46b6-8158-08f96e0cba62 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047730 Aug 11 16:34:04.635838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 512/923] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:05.646971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:05.649122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:05.655698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:05.656213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:05.656646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:05.657331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:05.657780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:05.658432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:05.687314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-253d06ff-7ff9-4810-9be1-1a6a56aafd6f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044279 Aug 11 16:34:05.687855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 513/924] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:05.692237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:05.692835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:05.698832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:05.699296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:05.699747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:05.700430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:05.700879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:05.701294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:05.764652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:05.772037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0a4f4aa5-1266-4151-b462-9b6f96f1c061 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083246 Aug 11 16:34:05.772616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 514/925] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:05 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:34:06.596255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:06.597005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:06.602998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.604063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.604525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.605215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.605672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.606097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.628541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b723bbf-ee99-46ac-ab5b-c4d34bc36058 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38/ips" status: 200 len: 151 microversion: 2.1 time: 0.036222 Aug 11 16:34:06.629094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 515/926] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:34:06 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:34:06.698825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:06.700962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:06.707219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.707690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.708142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.708817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.709263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.709676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.740008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-35a047eb-4546-4330-a804-2078542568d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045249 Aug 11 16:34:06.740586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 516/927] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:06.791759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:06.792387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:06.798117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.798594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.799301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.799983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:06.800458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:06.800874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:06.863884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:06.871446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a3f0d952-6f17-4aa9-803a-1520f1ab1a84 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083224 Aug 11 16:34:06.871997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 517/928] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:06 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:07.751817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:07.753971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:07.760948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:07.761521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:07.761958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:07.762643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:07.763097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:07.763521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:07.778859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:07.794433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f1cd631-494a-4823-b5e9-12b5fe38ff59 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046655 Aug 11 16:34:07.794979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 518/929] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:07.891897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:07.892527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:07.898308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:07.898790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:07.899224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:07.899904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:07.900380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:07.900805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:07.961758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:07.969436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-897dd72c-e051-4c4c-bb65-061b1cbc9b6a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081142 Aug 11 16:34:07.969991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 519/930] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:07 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:08.806779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:08.809708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:08.816153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:08.816641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:08.817091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:08.817780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:08.818339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:08.818871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:08.848360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6da0bd22-bdea-4f8b-b810-c9d590c6989c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Aug 11 16:34:08.848918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 520/931] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:08.989443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:08.990054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:08.996498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:08.996982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:08.997421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:08.998109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:08.998592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:08.999018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:09.060281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:09.067880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eff5b3b9-c398-4a44-b6cf-cc7f56577af2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082107 Aug 11 16:34:09.068476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 521/932] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:08 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:09.860741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:09.863010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:09.869425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:09.869925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:09.870362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:09.871047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:09.871498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:09.871905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:09.902919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8186649b-65b1-41d9-b918-b7c9d0178fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046125 Aug 11 16:34:09.903576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 522/933] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:10.089328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:10.090014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:10.095953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:10.096522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:10.096912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:10.097597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:10.098084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:10.098509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:10.159173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:10.167333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6e5543d-d9ef-4ea4-bff2-d642de68753d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081975 Aug 11 16:34:10.167887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 523/934] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:10 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:10.915469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:10.918467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:10.924898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:10.925381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:10.925816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:10.926500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:10.926951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:10.927371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:10.956053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-635915df-2a07-4263-936f-b25783d94a93 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044564 Aug 11 16:34:10.956614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 524/935] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:11.188611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:11.189162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:11.195116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.195598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.196030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:11.196753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.197206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.197631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:11.262539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:11.270185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5747c7fb-b7ca-4f08-ace8-3d6d1f96f6e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085904 Aug 11 16:34:11.270740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 525/936] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:11.428021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:11.428548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:11.434747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.435234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.435669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:11.436387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.436845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.437275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:11.460938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cd36cdf9-eaeb-43b9-8b4f-e8c43b602143 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1/ips" status: 200 len: 146 microversion: 2.1 time: 0.036729 Aug 11 16:34:11.461429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 526/937] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:34:11 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:34:11.968705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:11.970877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:11.977215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.977700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.978132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:11.979319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:11.979929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:11.980383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:12.009590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc5d939c-cdb5-4237-8a79-0d2642668eef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044983 Aug 11 16:34:12.010157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 527/938] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:12.291872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:12.292728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:12.298723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:12.299211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:12.299647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:12.300385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:12.300838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:12.301266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:12.362795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:12.370372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-434cb952-5b57-4675-b622-ed0a54525838 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082957 Aug 11 16:34:12.370935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 528/939] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:12 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:13.022176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:13.024378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:13.031384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:13.031871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:13.032346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:13.033042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:13.033498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:13.033921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:13.063194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e7e0496-e181-4879-9fb2-4cdeff0e4ba2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045027 Aug 11 16:34:13.063759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 529/940] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:13.390895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:13.391562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:13.397546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:13.398033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:13.398472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:13.399190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:13.399645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:13.400071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:13.460506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:13.468252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d9033bf9-a5b8-49d4-95b7-e7444084cd95 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081218 Aug 11 16:34:13.468811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 530/941] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:14.076718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:14.078857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:14.085398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:14.085877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:14.086311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:14.086997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:14.087448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:14.087869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:14.116887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da047fad-fc5d-46c2-a136-a3b86e4987a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045821 Aug 11 16:34:14.117428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 531/942] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:14.489826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:14.490352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:14.497462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:14.497943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:14.498379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:14.499063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:14.499516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:14.499934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:14.561890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:14.569391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00f348e7-254b-46dc-b665-2be1ac5ef5ff tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083575 Aug 11 16:34:14.569953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 532/943] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:14 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:15.129782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:15.131986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:15.139018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:15.139503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:15.139935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:15.140659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:15.141121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:15.141547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:15.170482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dbdfdff4-26d0-4676-b761-5a55a6170300 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Aug 11 16:34:15.171026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 533/944] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:15.590829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:15.591439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:15.597620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:15.598106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:15.598540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:15.599260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:15.599716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:15.600164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:15.664067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:15.671731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-162df302-cb68-4383-a726-47da57973d15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084950 Aug 11 16:34:15.672307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 534/945] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:16.183059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:16.185471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:16.191797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:16.192303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:16.192735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:16.193414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:16.193860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:16.194277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:16.208220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:16.226790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1deb87d-4f3b-4d93-a705-741ec0a02cd6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047945 Aug 11 16:34:16.227337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 535/946] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:16.692728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:16.693363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:16.700232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:16.700711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:16.701139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:16.701817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:16.702267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:16.702684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:16.764360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:16.772019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5d819241-19c8-48c8-a1e6-437cd28d5de2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083075 Aug 11 16:34:16.772611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 536/947] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:16 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:17.240022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:17.242115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:17.249480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:17.249966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:17.250399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:17.251090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:17.251544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:17.251967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:17.281628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00c8e97e-ec6b-4ddf-8df9-1342ecc1637d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045722 Aug 11 16:34:17.282182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 537/948] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:17.793365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:17.793918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:17.800543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:17.801021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:17.801448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:17.802129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:17.802574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:17.802991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:17.864022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:17.871619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ac3ea17-8bfd-4a0f-9f8b-4e480f8388a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082248 Aug 11 16:34:17.872188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 538/949] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:18.294586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:18.296756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:18.303151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:18.303633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:18.304072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:18.304789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:18.305240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:18.305662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:18.337385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5e17262-bd98-447e-abd4-66ab96113ec8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047260 Aug 11 16:34:18.337858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 539/950] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:18.892431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:18.893046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:18.900001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:18.901323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:18.902110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:18.902854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:18.903313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:18.904654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:18.974188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:18.983076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7710fb0f-6b58-419c-a276-8e972526f188 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.094549 Aug 11 16:34:18.983646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 540/951] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:18 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:19.350740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:19.352958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:19.359500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:19.359984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:19.360521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:19.361224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:19.361682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:19.362140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:19.392080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44d205fd-4080-448b-900b-8d5f901e763e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045356 Aug 11 16:34:19.392652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 541/952] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:20.004117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:20.004727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:20.010720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:20.011197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:20.011628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:20.012337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:20.012786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:20.013203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:20.076317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:20.083755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba7f8e71-667b-49c4-9bc6-a2d9af068d29 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083507 Aug 11 16:34:20.084348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 542/953] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:19 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:20.406283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:20.408471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:20.414962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:20.415447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:20.415886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:20.416613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:20.417071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:20.417493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:20.446535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac98b9fa-f6a8-4664-836f-fc42495f1f0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045697 Aug 11 16:34:20.447092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 543/954] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:21.105150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:21.105773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:21.111695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:21.112195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:21.112641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:21.113298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:21.113743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:21.114158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:21.174814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:21.183012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c17bd755-a80f-42f8-a794-eef7224b17fd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082109 Aug 11 16:34:21.183575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 544/955] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:21.460378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:21.462424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:21.465656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:21.471161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:21.471644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:21.472080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:21.472860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:21.473313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:21.473738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:21.503875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2cd55fb2-ffc5-46dd-b57b-f4baf548b76f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047618 Aug 11 16:34:21.504450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 545/956] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:22.203414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:22.204030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:22.209982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:22.210464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:22.210901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:22.211588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:22.212042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:22.212492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:22.272657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:22.280172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-72db08b1-b881-4d7b-a222-3bb2a6ff4aa5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.080600 Aug 11 16:34:22.280741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 546/957] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:22.516502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:22.518679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:22.525033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:22.525567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:22.526184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:22.526869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:22.527353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:22.527770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:22.556432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aa1b471c-5775-4194-b16c-78e5388d7b40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043891 Aug 11 16:34:22.557587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 547/958] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:23.300704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:23.301472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:23.307490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:23.307908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:23.308395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:23.309075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:23.309780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:23.310195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:23.377152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:23.384754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3d113dbb-8f1d-4dcf-bb55-ba20dd41f972 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087928 Aug 11 16:34:23.385315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 548/959] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:23 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:23.568941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:23.571010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:23.577972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:23.578446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:23.578873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:23.579548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:23.579992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:23.580431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:23.608910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-201b3432-7f22-4af6-9028-d9eb1f96596a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Aug 11 16:34:23.609448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 549/960] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:24.407092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:24.407652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:24.413770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:24.414250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:24.414681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:24.415366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:24.415818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:24.416281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:24.479345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:24.487482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8aac5387-c755-4252-9f86-636b03e062db tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084393 Aug 11 16:34:24.488043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 550/961] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:24 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:24.621327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:24.623491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:24.629875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:24.630359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:24.630795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:24.631485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:24.631937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:24.632403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:24.661653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51de724a-aa1e-4f40-92d4-1844e784cb89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044405 Aug 11 16:34:24.662117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 551/962] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:25.508410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:25.509020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:25.514982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:25.515462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:25.515897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:25.516608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:25.517062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:25.517480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:25.521424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:25.579169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:25.586576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99d4f161-57be-40d5-8270-e8ac5dc6579b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082084 Aug 11 16:34:25.587133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 552/963] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:25.674886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:25.677070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:25.684583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:25.685063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:25.685494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:25.686175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:25.686621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:25.687038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:25.715271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f0115c79-d50b-4bad-8ebe-1a281db2a392 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Aug 11 16:34:25.715802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 553/964] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:26.607615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:26.608270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:26.614242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:26.614716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:26.615143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:26.615825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:26.616306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:26.616722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:26.677217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:26.685659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24087a79-cf30-4dca-8b0c-a543c54d716b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082024 Aug 11 16:34:26.686215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 554/965] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:26 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:26.727556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:26.729708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:26.735809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:26.736319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:26.736749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:26.737427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:26.737871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:26.738288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:26.767071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b824732-29e4-40c6-8759-0ffbbe27b380 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 Aug 11 16:34:26.767602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 555/966] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:34:27.705811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:27.706471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:27.713024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:27.713508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:27.713971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:27.715555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:27.716227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:27.716852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:27.779202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:27.786802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9d6b4f4-8567-4586-86f3-2893b96d94ae tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084833 Aug 11 16:34:27.787369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 556/967] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:27 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:27.792006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:27.794138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:27.799695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:27.800209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:27.800648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:27.801328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:27.801779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:27.802203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:27.831054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab19eeac-06f1-4931-82ee-7da196de8dd4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042647 Aug 11 16:34:27.831588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 557/968] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:28.807345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:28.808550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:28.815436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:28.815916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:28.816377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:28.817066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:28.817517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:28.817936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:28.881198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:28.889578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6f08024e-6f7e-422b-8f75-6046806455e7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086142 Aug 11 16:34:28.890139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 558/969] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:28.894608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:28.896738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:28.902669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:28.903151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:28.903586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:28.904307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:28.904762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:28.905190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:28.935446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-58d4c65e-30eb-4537-83f7-67e50847ca0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044319 Aug 11 16:34:28.935983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 559/970] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:29.910268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:29.910933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:29.918008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:29.918578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:29.919040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:29.919727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:29.920210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:29.920634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:29.982473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:29.990099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-89072af3-5990-42eb-9feb-3fccefc0bbe2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083699 Aug 11 16:34:29.990695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 560/971] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:29 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:29.995642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:29.997782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:30.003837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:30.004356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:30.004787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:30.005474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:30.005921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:30.006336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:30.035362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7bcb1555-9232-4b21-bb14-2f09346006ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043686 Aug 11 16:34:30.035899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 561/972] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:31.011177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:31.011884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:31.018284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:31.018766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:31.019200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:31.019884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:31.020367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:31.020790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:31.081508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:31.089131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a15c121c-e069-4b35-ad47-89c164c1a530 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081814 Aug 11 16:34:31.090286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 562/973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:31.094872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:31.097019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:31.103043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:31.103531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:31.103967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:31.104781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:31.105330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:31.106304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:31.134293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a6a50bb8-0daf-48f6-898e-11f7a664d189 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043019 Aug 11 16:34:31.134842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 563/974] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:32.110440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:32.111086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:32.117410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.117886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.118313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:32.118993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.119435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.119848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:32.179651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:34:32.188172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7dfaf22c-c905-4906-9c5a-5c7b23f24c4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081588 Aug 11 16:34:32.188728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 564/975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:34:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:34:32.193204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:32.195290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:32.201694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.202162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.202591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:32.203264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.203708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.204144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:32.232347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3330764c-9a3f-43cb-ac02-7c1558ef93a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042609 Aug 11 16:34:32.232878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 565/976] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:34:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:34:32.672459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:34:32.672953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:34:32.679037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.679516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.679953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:32.680678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:34:32.681128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:34:32.681547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:34:42.676392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=43 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:34:42.700988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=87 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:15.952137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:35:15.953934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:35:15.955268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:15.955991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:15.957409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 409 to user: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:15.958434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f1e4d0ad-b229-4ceb-b7f9-9bad0acc28b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 409 len: 152 microversion: 2.1 time: 103.346702 Aug 11 16:35:15.958434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 412/977] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:33:32 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 152 bytes in 103348 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 11 16:35:16.064313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.065030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.071900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.072418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.073064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.074021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.074518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.074948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.139451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:16.147630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ade505be-4c60-43d6-b414-9023796da969 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.190740 Aug 11 16:35:16.148252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 413/978] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:16.152832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.155810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.167227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.167732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.168179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.168912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.169662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.169940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.203254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a10b8180-f6eb-4d46-bfd3-8031509efd3b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053968 Aug 11 16:35:16.203829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 414/979] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:16.211922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.212463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.219507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.220228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.220456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.221348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.221973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.222430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.250897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:35:16.334953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8a9710da-87e9-4678-987d-229db1a0d26f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 204 len: 0 microversion: 2.1 time: 0.129459 Aug 11 16:35:16.335618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 415/980] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:35:16 2022] DELETE /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:35:16.341017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.341595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.347828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.348353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.348790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.349486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.349935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.350357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.377501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:35:16.466362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0a4fcd9a-5e1b-4f14-a918-6ecf81ac67e4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 204 len: 0 microversion: 2.1 time: 0.129273 Aug 11 16:35:16.470758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 416/981] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:35:16 2022] DELETE /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:35:16.472844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.473599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.480087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.480911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.481379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.482282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.483408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.484061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.488394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:35:16.490044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:35:16.491658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:16.492522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:16.494091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 409 to user: Cannot 'detach_volume' instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 while it is in vm_state rescued {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:16.495395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6642e13a-b5fa-4d4a-a5a0-a22ef1076c4f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 409 len: 152 microversion: 2.1 time: 43.823235 Aug 11 16:35:16.496572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 566/982] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:34:32 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 152 bytes in 43828 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 11 16:35:16.501859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.502490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.508722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.509206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.509641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.510342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.510800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.511217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.624176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:16.632152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a758d811-b93e-4da2-b864-ca7875cb3d0a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1684 microversion: 2.1 time: 0.163269 Aug 11 16:35:16.632724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 417/983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:16 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:16.637198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:16.637905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.648635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.649126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.649561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.650256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:16.650606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.651061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.651492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.658500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c54bbe07-6c28-4748-82ca-bcfb05ababc4 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1673 microversion: 2.1 time: 0.160904 Aug 11 16:35:16.659066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 567/984] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:16 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:16.716786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-06b2254d-f3f8-40d7-859a-ad7d883d7de0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action" status: 202 len: 0 microversion: 2.1 time: 0.082844 Aug 11 16:35:16.717947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 418/985] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:35:16 2022] POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:35:16.726603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:16.727216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:16.734495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.734978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.735420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.736129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:16.736578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:16.737002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:16.863142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:16.871219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1acfa72a-72bb-4899-a567-a5b913286bd6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1721 microversion: 2.1 time: 0.148534 Aug 11 16:35:16.871771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 568/986] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:17.169343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:17.170063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:17.176244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.176727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.177164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.177851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.178301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.178723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.215768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:17.219634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:17.225863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.226454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.226948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.227709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.228282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.228770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.247174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:17.255339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b310569a-2e83-40b1-93c5-27540a24963d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.090743 Aug 11 16:35:17.255904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 419/987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:17.258950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bf53001-f033-4692-a1b8-297e36589687 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047141 Aug 11 16:35:17.259489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 569/988] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:17.655011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:17.655694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:17.661596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.662079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.662510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.663187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.663634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.664052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.680584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:17.681234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:17.688032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.688893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.689529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.690553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.691013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.691446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.793066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:17.800802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-374cf4bc-c763-48ce-9944-4f42e7bf3b5d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1684 microversion: 2.1 time: 0.150199 Aug 11 16:35:17.801372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 420/989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:17 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:17.822816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:17.831148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f824d6a0-2b03-4d71-b771-8a7b0f2afaab tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1673 microversion: 2.1 time: 0.154429 Aug 11 16:35:17.831705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 570/990] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:17 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:17.893079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:17.893688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:17.899550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.900034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.900508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:17.901202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:17.901660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:17.902087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.033868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:18.041849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-07db566c-7ed9-4411-a5ba-c3be424cf73f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1721 microversion: 2.1 time: 0.153121 Aug 11 16:35:18.042404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 421/991] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:18.271251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:18.273499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:18.277013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:18.277652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:18.279482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.279969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.280448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.281150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.281659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.282035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.284064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.284570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.285004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.285689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.286136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.286552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.312264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a52afc70-9296-4590-ae0f-ac18ce495176 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Aug 11 16:35:18.312821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 571/992] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:18.347860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:18.355435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f26b6585-eb29-485c-a864-add916c64a67 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082174 Aug 11 16:35:18.355991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 422/993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:18 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:18.822624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:18.823225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:18.830490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.831167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.831602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.833290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.833752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.834173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.852608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:18.854288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:18.861992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.862776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.863473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.864430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:18.865098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:18.865716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:18.971071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:18.978602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6799bf51-7b88-48ee-8d66-753baf90bbc4 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1684 microversion: 2.1 time: 0.159737 Aug 11 16:35:18.979164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 572/994] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:18 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:19.063330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:19.064056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:19.069921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.070600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.071222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.071927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.072442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.072864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.210315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:19.219806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b15ccaa9-4abf-4a5e-93a1-2077b996193d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1721 microversion: 2.1 time: 0.160679 Aug 11 16:35:19.220831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 573/995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:19.327918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:19.330542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:19.337151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.337635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.338097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.338922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.339232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.339706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.371564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:19.375278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c78303f-1ac9-415a-8aba-6476bc1f7cea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052224 Aug 11 16:35:19.376139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 574/996] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:19.381097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:19.381702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:19.383173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bcc24eec-2c35-45d7-be3c-b3c14a892560 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1673 microversion: 2.1 time: 0.534251 Aug 11 16:35:19.383822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 423/997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:18 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1673 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:19.397725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.398217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.398650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.399354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:19.399868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:19.400317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:19.469882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:19.478161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fcdb2bef-5c67-41ca-b150-1ee8f721dd04 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.100395 Aug 11 16:35:19.480239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 575/998] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:19 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:20.000574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:20.001225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:20.010438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.011355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.011973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.012903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.014228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.014927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.243603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:20.244295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:20.251478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.251895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.252362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.253061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.253525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.253940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.391874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:20.406230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4f11c6ba-adf3-4881-b9f3-fceb7de99aa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1721 microversion: 2.1 time: 0.166416 Aug 11 16:35:20.406822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 576/999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:20.422710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:20.425079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:20.431204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.431695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.432165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.432871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.433325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.433747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.465602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f8cac9b9-1be1-40cc-8249-ea658fa539e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049738 Aug 11 16:35:20.466170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 577/1000] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:20.471288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:20.471930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:20.477873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.478363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.478802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.479505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.479959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.480493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.566671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:20.570920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:20.576384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-25f4c261-87e1-47d6-9b59-7ada65f2f37f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1684 microversion: 2.1 time: 0.580112 Aug 11 16:35:20.585724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 424/1001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:19 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1684 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:20.593986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:20.594945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:20.602974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.603513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.603880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.604723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:20.605127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:20.605760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:20.620651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:20.629555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bf27a2f3-4df7-4b16-a75e-529a7de776c2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1673 microversion: 2.1 time: 0.162390 Aug 11 16:35:20.630123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 578/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:20 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:20.713362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:20.720996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9c98fa5a-7536-42f2-b6f4-c4b6076ba321 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.133302 Aug 11 16:35:20.721572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 425/1003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:21.399828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cf20b4-6343-405c-a68c-4d92de212cc1", "name": "network-vif-deleted", "tag": "75169d22-cc9d-4a7c-bda1-cb6a9c81881d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:21.411631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.411899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.412406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.428645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:21.429184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] Creating event network-vif-deleted:75169d22-cc9d-4a7c-bda1-cb6a9c81881d for instance 76cf20b4-6343-405c-a68c-4d92de212cc1 on hv-cinder-85220 Aug 11 16:35:21.429711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:21.437421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-8aa335a7-acff-4b29-b5f7-88f467336586 req-4d1af6e3-7e13-4d45-ace3-4e0ed4c5845e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104979 Aug 11 16:35:21.438588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 579/1004] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:21.441718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.442451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.442896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.443611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.444349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.444766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.479493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:21.481944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:21.491125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.491977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.492646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.493743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.494209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.494638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.526781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d7bed99e-133a-45d3-b341-9d4a595726d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051478 Aug 11 16:35:21.527357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 580/1005] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:21.598253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:21.598768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:21.599330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:21.606160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.606649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.607091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.607903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.608387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.608814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.609795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e6784511-f415-4dfc-b326-c2b80429ae29 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1721 microversion: 2.1 time: 0.185250 Aug 11 16:35:21.623757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 426/1006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:21.661377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:21.666870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:21.674997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.675760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.676543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.677490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.678012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.678509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.682866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:21.693478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-229c04d9-57df-4caa-8590-c6365e80976a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1616 microversion: 2.1 time: 0.098517 Aug 11 16:35:21.702500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 581/1007] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:21 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1616 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:21.742892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:21.744082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:21.752432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:21.755117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.755610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.756043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.756771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:21.757390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:21.758107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:21.765683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0d2f01ba-e575-4f35-aedf-bf354ab096b2 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1606 microversion: 2.1 time: 0.112463 Aug 11 16:35:21.766916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 427/1008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:21 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:21.825138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:21.848765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f13382e0-3533-4ca2-b6c5-833d49ee7ca4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.110093 Aug 11 16:35:21.849730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 582/1009] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:22.539078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.541381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.549974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.550574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.551275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.552192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.552714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.553235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.588814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bca12ec7-1d48-44c6-8e28-dd293e0a2eaa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054266 Aug 11 16:35:22.589546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 428/1010] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:22.630888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.631506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.638079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.638563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.639031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.639915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.640393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.640823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.714806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.715542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.722381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.722870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.723302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.724045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.724527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.724948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.757148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.757634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.758103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.758554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lazy-loading 'fault' on Instance uuid 364a5b7f-5bb8-405e-a07a-6256f38a1b38 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:35:22.772427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:22.775911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:22.781914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-18956aa2-31f3-49eb-86de-b917959d2a40 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1727 microversion: 2.1 time: 0.154895 Aug 11 16:35:22.782491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 583/1011] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:22.786980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.787587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.793995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.794406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.794840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.795590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.796301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.796684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.804787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:22.812557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-00169bad-e0b7-4e3d-8003-136f2ea98367 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 200 len: 1332 microversion: 2.1 time: 0.101520 Aug 11 16:35:22.813126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 429/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:22.817925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.818421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.824209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.824700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.825138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.825837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.826849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.827364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.830063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.830548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.830980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.831425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lazy-loading 'fault' on Instance uuid 76cf20b4-6343-405c-a68c-4d92de212cc1 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:35:22.872250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a5ab962b58f473f874bd94bfe2db6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d15983e6d8e4ad6887105f88f187044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:22.880410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-deb3d04c-bc87-4e24-a14a-63c147ca0d27 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 200 len: 1327 microversion: 2.1 time: 0.096908 Aug 11 16:35:22.880979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 584/1013] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:22.885368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:22.885973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:22.891603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.892084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.892541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.893232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:22.893677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:22.894098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:22.907662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-21d7f34b-2fd4-4015-b7cc-360912e8dfab tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093261 Aug 11 16:35:22.908377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 430/1014] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:22.956496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:22.964139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82a3acc0-292c-4beb-afcb-e81de3348ff0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082125 Aug 11 16:35:22.964682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 585/1015] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:23.451104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364a5b7f-5bb8-405e-a07a-6256f38a1b38", "name": "network-vif-deleted", "tag": "86f53121-5a7e-4481-9414-02491e39e779"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:23.460617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.461082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.461517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.473084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] Creating event network-vif-deleted:86f53121-5a7e-4481-9414-02491e39e779 for instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 on hv-cinder-85220 Aug 11 16:35:23.477849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-184f6aeb-a77c-4436-bc1f-e5470df9f9b7 req-97509381-0b1a-4113-a815-9821d3a41b95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Aug 11 16:35:23.478427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 431/1016] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:23.602821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.605139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:23.611956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.612479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.612913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.613642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.614091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.614511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.648656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eed321fc-a29a-4cb1-8244-c658cf127627 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049612 Aug 11 16:35:23.649572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 586/1017] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:23.836244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.836938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:23.843277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.843760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.844264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.845058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.845553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.846002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.860923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 HTTP/1.1 Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:35:23.862840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:35:23.864370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '364a5b7f-5bb8-405e-a07a-6256f38a1b38'} Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:23.865161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:35:23.867252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.870252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:23.870252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d117d1b5-534f-4c46-b4d0-017ba49074a0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 404 len: 111 microversion: 2.1 time: 0.032916 Aug 11 16:35:23.870252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 432/1018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:23 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:35:23.874211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4ca4373-117a-48da-9152-783e5f3f85cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '.version_select at 0x7f614330c820>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.892982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4ca4373-117a-48da-9152-783e5f3f85cd tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591501794" status: 202 len: 0 microversion: 2.1 time: 0.023208 Aug 11 16:35:23.893551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 587/1019] 10.222.0.43 () {58 vars in 1221 bytes} [Thu Aug 11 16:35:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1591501794 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:35:23.900685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.901290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:23.908455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.908937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.909368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.910059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.910499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.910917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.925767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 HTTP/1.1 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:35:23.927393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:23.929168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '76cf20b4-6343-405c-a68c-4d92de212cc1'} Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:23.930487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:23.932075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:23.933354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:23.933354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2df80530-2f32-4b12-8838-7ca32bbb3d2c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 404 len: 111 microversion: 2.1 time: 0.032024 Aug 11 16:35:23.933354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 433/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:23 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:35:23.939630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3b15c66a-fe2b-42d2-b6c7-aa30bf0ea227 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '.version_select at 0x7f6143542b80>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.959523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3b15c66a-fe2b-42d2-b6c7-aa30bf0ea227 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988576629" status: 202 len: 0 microversion: 2.1 time: 0.024196 Aug 11 16:35:23.960485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 588/1021] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Aug 11 16:35:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988576629 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:35:23.989157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:23.990233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:23.996806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.997413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:23.998218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:23.998983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:23.999496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.000402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.102304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:24.121367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-664d316e-40d0-41c1-8e73-fa4bac517cb7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.136398 Aug 11 16:35:24.122116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 434/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:23 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:24.661805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:24.664735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:24.676406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.677347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.679117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.680468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.681246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.681839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.723741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a33aa238-3c1f-45bb-bbbc-b354eeb482a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065802 Aug 11 16:35:24.724352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 589/1023] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:24.727759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-17120ee2-b7ad-417b-b73e-44605e43b67d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: .version_select at 0x7f614be32e50>, body: {"keypair": {"name": "tempest-keypair-716615196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQE3p3gG4T7wl3ToJPzMPl2Fb1kadkQhlUQEbbwlsKerEBIuLrm7whxsltvB6YbmWWCZxe/GE6ENeptonofdLWuXYBpCrBiuYhIZY7wedp1V3YW8ZpphL9W5SFqDfTQJA=="}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:24.749954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-17120ee2-b7ad-417b-b73e-44605e43b67d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:35:24.754029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-17120ee2-b7ad-417b-b73e-44605e43b67d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'key_pairs'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:35:24.779863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-17120ee2-b7ad-417b-b73e-44605e43b67d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057152 Aug 11 16:35:24.781132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 435/1024] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 16:35:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:24.802411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:24.802907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:24.812000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.812676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.813112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.813820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.814269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.814689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.829418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 HTTP/1.1 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:35:24.831116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.832759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '76cf20b4-6343-405c-a68c-4d92de212cc1'} Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:24.836834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.838275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.839677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:24.839677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2070c33f-c81e-4175-ac56-44a1ffc82b2e tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 404 len: 111 microversion: 2.1 time: 0.034037 Aug 11 16:35:24.839677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 590/1025] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:35:24 2022] DELETE /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:35:24.845248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:24.845958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 76cf20b4-6343-405c-a68c-4d92de212cc1] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:24.853352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.853946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.854456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.855285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:24.856068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:24.856267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:24.874824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 HTTP/1.1 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:35:24.876435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.877793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '76cf20b4-6343-405c-a68c-4d92de212cc1'} Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:35:24.878518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. Aug 11 16:35:24.879697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:35:24.880827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 76cf20b4-6343-405c-a68c-4d92de212cc1 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:35:24.880827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ceaae11-600c-4437-9fca-de5f217af7a5 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1" status: 404 len: 111 microversion: 2.1 time: 0.036958 Aug 11 16:35:24.881868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 436/1026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:24 2022] GET /compute/v2.1/servers/76cf20b4-6343-405c-a68c-4d92de212cc1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:35:25.141806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:25.142429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:25.149004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:25.149579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:25.150022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:25.150732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:25.151189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:25.151618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:25.229766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:25.239898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab43874a-7940-49ca-bf51-7baa33e95d88 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.101954 Aug 11 16:35:25.240688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 591/1027] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:25.510198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}, {"name": "network-changed", "server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:25.520379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:25.520852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:25.521278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:25.533660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Creating event network-changed:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 16:35:25.534173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] Creating event network-changed:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 16:35:25.539802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-6786108f-2c2b-4942-a0fe-bd3e2b7c1db6 req-1a822ba3-563d-45eb-9022-961c20a55233 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032975 Aug 11 16:35:25.540762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 437/1028] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:25.739624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:25.743977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:25.754885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:25.756161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:25.756819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:25.758426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:25.758964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:25.759430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:25.791998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-140cb803-e84b-4335-a66b-82ad096756da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059114 Aug 11 16:35:25.792998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 592/1029] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:26.261893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:26.262377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:26.273347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.273347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.273347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.273347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.273682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.273682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.315467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-794167440", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6247ee74-ce66-47ac-ae21-9c4793c44289"}], "security_groups": [{"name": "tempest-securitygroup--1344132209"}], "key_name": "tempest-keypair-716615196", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:26.350258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:26.359018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d36ff08f-8a85-48db-b9bf-db8e3fa9e386 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.101306 Aug 11 16:35:26.359957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 438/1030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:26 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:26.426280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] validate_networks() for [('6247ee74-ce66-47ac-ae21-9c4793c44289', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:35:26.802927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:35:26.803600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:35:26.803806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:35:26.804213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:26.804348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:35:26.804642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:35:26.806335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:26.812632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.813104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.813527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.813935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.814206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.814404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.814651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.814830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.815067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.815546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:26.815991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:26.816431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:26.833431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:35:26.837373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Getting quotas for user e7e5b04101c1403d9b3a311803ac798f and project 91ed4e8fe7284bd5863ba22aa552e60b. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:35:26.846016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5da5fb1f-f2d7-4591-95b1-56a76a15ca0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Aug 11 16:35:26.846578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 439/1031] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:26.849024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:35:26.851261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:35:26.896529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32a5b2d3-c14e-409a-bcbc-73f80b442ea0 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585612 Aug 11 16:35:26.897171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 593/1032] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 16:35:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 16:35:26.908666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a5d3770-a808-419d-83bc-56a2ae96eabb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:26.909278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a5d3770-a808-419d-83bc-56a2ae96eabb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:26.965066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4a5d3770-a808-419d-83bc-56a2ae96eabb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:26.971677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a5d3770-a808-419d-83bc-56a2ae96eabb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1240 microversion: 2.1 time: 0.067531 Aug 11 16:35:26.972268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 440/1033] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:26 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:27.378943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:27.379551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:27.386584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:27.387203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:27.387652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:27.388387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:27.388832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:27.389248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:27.453841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:27.463419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3fb6348-4b28-4064-861d-f1251bae7974 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088495 Aug 11 16:35:27.463982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 594/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:27 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:27.858612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:27.861948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:27.870793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:27.871613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:27.872591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:27.873410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:27.874600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:27.875273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:27.907376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e84d94f2-85ba-4b7b-b115-458e7084986a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052917 Aug 11 16:35:27.908286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 441/1035] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:27.992885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:27.993493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:28.000486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.000959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.001390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.002073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.002520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.002937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.065589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:28.073020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ea331eb-64fb-43ea-994f-3110b41b9fad tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1298 microversion: 2.1 time: 0.084049 Aug 11 16:35:28.073582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 595/1036] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:27 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:28.485669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:28.486280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:28.492412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.492899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.493335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.494023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.494481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.494906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.585245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:28.593860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9c9ba0a6-9c3a-41c5-b5d1-3fa3f8fb1c73 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.112828 Aug 11 16:35:28.595145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 442/1037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:28.918935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:28.922073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:28.928117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.928620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.929058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.929781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:28.930233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:28.930667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:28.962813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f92473d-4334-40a6-b857-eb4e34543b6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047768 Aug 11 16:35:28.963471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 596/1038] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:29.095031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:29.095659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:29.102115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.102676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.103117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.103816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.104300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.104726 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.285494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85b83f4-8ebf-41f4-9a1d-8186773c0c45", "tag": "522aaee5-634f-4b7e-ad5a-95f296c91d76"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:29.295753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.296452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.297014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.309165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] Creating event network-changed:522aaee5-634f-4b7e-ad5a-95f296c91d76 for instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 on hv-cinder-85220 Aug 11 16:35:29.315019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-50632482-6390-42c2-9903-a1ed7c857c82 req-287bb2fa-30fb-47d6-9d9b-af3c46d61c67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034440 Aug 11 16:35:29.315616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 597/1039] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:35:29.363069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:29.370728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-26ae5bdb-cbe4-4612-adb7-88779c6c5626 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.280195 Aug 11 16:35:29.371305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 443/1040] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:29 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:29.616119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:29.616822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:29.623067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.623549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.623987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.625551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.626012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.626435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.689154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:29.696755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9123bbdd-30c4-4c9d-a493-70cae0b7b620 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084856 Aug 11 16:35:29.697495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 598/1041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:29 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:29.975323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:29.977598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:29.984258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.984975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.985414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:29.986102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:29.986554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:29.986979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:30.015894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dad40e80-4f93-4d51-adf8-7229650dc4c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Aug 11 16:35:30.016473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 444/1042] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:30.393200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:30.393821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:30.400678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:30.401190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:30.401629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:30.402315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:30.402769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:30.403193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:30.535180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:30.542673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cab867e6-9065-482c-a70c-5acf94a6e73a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.153903 Aug 11 16:35:30.543237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 599/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:30 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:30.717553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:30.718315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:30.725041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:30.725565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:30.726005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:30.726697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:30.727146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:30.727570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:30.807522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:30.815938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6e84ed90-cee1-4696-bfaf-7789011e7900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.102266 Aug 11 16:35:30.816539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 445/1044] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:30 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:31.027797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:31.030009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:31.036613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.037091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.037523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.038205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.038657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.039076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.070367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80b405c1-8aaf-4615-9148-87754e16adee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046880 Aug 11 16:35:31.070919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 600/1045] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:31.563292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:31.563898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:31.575506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.575984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.576455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.577182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.577738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.578157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.707049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:31.710604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:31.715371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bda10cfb-05ed-4fa3-a85a-e2b26225a4cb tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.156501 Aug 11 16:35:31.715939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 446/1046] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:31 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:31.837653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:31.838189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:31.845399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.845883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.846316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.847005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:31.847486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:31.847909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:31.907960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:31.915383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e7f5ab9-882c-4bf6-ac1d-a53f7b564299 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081770 Aug 11 16:35:31.915945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 601/1047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:32.083063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:32.085213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:32.091505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.091924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.092389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:32.093698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.094141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.094555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:32.122459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e42dd7c9-5f39-43e5-9ada-57b7b628d86d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043457 Aug 11 16:35:32.123001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 447/1048] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:32.737357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:32.738099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:32.744234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.744717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.745153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:32.745842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.746293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.746714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:32.873318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:32.881551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2628f7e5-f4d1-43ea-b796-aea350cffd61 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.148483 Aug 11 16:35:32.882141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 602/1049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:32 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:32.937459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:32.938072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:32.944106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.944603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.945035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:32.945721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:32.946168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:32.947055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:33.009344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:33.017676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9d410030-b83e-4973-9f18-27a742d51ade tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084993 Aug 11 16:35:33.018251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 448/1050] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:33.135200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:33.137407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:33.143890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:33.144416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:33.144847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:33.145530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:33.145979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:33.146399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:33.175917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d0331e7-1172-4353-b9e8-98a9ea20018f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044705 Aug 11 16:35:33.176514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 603/1051] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:33.903344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:33.903949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:33.907994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:33.912042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:33.912546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:33.912977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:33.913671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:33.914117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:33.914531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.038451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:34.039079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:34.046308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:34.046901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:34.047529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.048057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:34.048557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:34.048979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.054775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:34.130014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:34.137470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8b81ddf4-f5e4-4df8-bdf9-97360a35deeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.102915 Aug 11 16:35:34.138051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 604/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:34 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:34.188714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:34.191047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:34.194886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:34.198918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:34.199486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:34.200020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.200838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:34.201359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:34.201878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.208689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:34.217581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8518963e-120e-436d-bd1e-8cde848cea13 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.318129 Aug 11 16:35:34.218154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 449/1053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:33 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:34.237338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc2c856f-efe3-42c0-9bbc-734268859beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053012 Aug 11 16:35:34.237907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 605/1054] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:34.682551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85b83f4-8ebf-41f4-9a1d-8186773c0c45", "name": "network-vif-plugged", "status": "completed", "tag": "522aaee5-634f-4b7e-ad5a-95f296c91d76"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:34.692722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:34.693200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:34.693628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:34.704952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] Creating event network-vif-plugged:522aaee5-634f-4b7e-ad5a-95f296c91d76 for instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 on hv-cinder-85220 Aug 11 16:35:34.709856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-97e17699-e75b-4a18-b74e-36cb8ab3e549 req-13e56b61-45a1-45e3-9c1a-13e2408e49e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085538 Aug 11 16:35:34.710414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 450/1055] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:35.159087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:35.159670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:35.166157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.166637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.167074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.167759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.168284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.168733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.230158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:35.237772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a812b96-305c-4cfb-97a7-e079e09a9ee9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082596 Aug 11 16:35:35.238344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 606/1056] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:35 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:35.240141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:35.240832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:35.246924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.247395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.247853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.248556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.249654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.250319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.255090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:35.257270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:35.263112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.263596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.264060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.265415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:35.266013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:35.266268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:35.295043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eaaa90d2-cb1a-4d09-8f08-41668c9be77c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044569 Aug 11 16:35:35.295616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 607/1057] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:35.378988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:35.386448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1e026305-55e6-4856-aaa5-418927df6049 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.150919 Aug 11 16:35:35.387011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 451/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:35 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:36.259046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:36.259650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:36.267386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.268210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.268826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.269520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.269967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.270383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.307110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:36.309298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:36.316916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.317409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.317848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.318561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.319017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.319443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.335186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:36.342601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-942b6207-0358-4cc1-b179-594ab59c0f49 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087638 Aug 11 16:35:36.344195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 608/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:36 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:36.351475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc687a07-48f7-48f7-9d81-f5cb6f25597a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048346 Aug 11 16:35:36.352265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 452/1060] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:36.408738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:36.409354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:36.415257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.415740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.416210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.416904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:36.417359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:36.417786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:36.550739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:36.558253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d9bdb04-420c-425c-b2ff-79efb224ec97 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1366 microversion: 2.1 time: 0.154065 Aug 11 16:35:36.558748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 609/1061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:36 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:37.364281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:37.364915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:37.365298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:37.366515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:37.366759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:37.367409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:37.368718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:37.375148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.375543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.375685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.376029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.376299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.376564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.377261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.377399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.377715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.377855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.378135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.378277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.410155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fee60285-84ca-45f9-b71a-68eeaaf2360e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049783 Aug 11 16:35:37.410723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 453/1062] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:37.443730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:37.451462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a1d9abcd-3e3b-4b0b-8300-755905f4a044 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.091034 Aug 11 16:35:37.452086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 610/1063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:37 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:35:37.580148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:37.580757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:37.586644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.587117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.587545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.588247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.588694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.589110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.719431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:37.727145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c13d3fdb-7ce4-4d11-870d-2003d44e6a8a tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1556 microversion: 2.1 time: 0.150743 Aug 11 16:35:37.727713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 454/1064] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:37 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:37.747907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:37.748440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:37.755328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.755814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.756295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.756991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:37.757448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:37.757876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:37.835877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-badfa62f-9680-48e2-9564-21dfe9a64094 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091810 Aug 11 16:35:37.836506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 611/1065] 10.222.0.43 () {58 vars in 1275 bytes} [Thu Aug 11 16:35:37 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:38.423478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:38.425634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:38.432038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:38.432554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:38.432986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:38.433677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:38.434234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:38.434661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:38.464444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-07d50b41-858f-449a-a1b0-3bd8296d51e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Aug 11 16:35:38.465003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 455/1066] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:38.473235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:38.473874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:38.479978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:38.480502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:38.480943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:38.481638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:38.482094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:38.482579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:38.571397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:38.579375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee7f8f35-2001-4eaf-8c45-4ccb976a6c0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.110730 Aug 11 16:35:38.579956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 612/1067] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:38 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:38.777671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85b83f4-8ebf-41f4-9a1d-8186773c0c45", "tag": "522aaee5-634f-4b7e-ad5a-95f296c91d76"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:35:38.787897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:38.788472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:38.788964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:38.801464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] Creating event network-changed:522aaee5-634f-4b7e-ad5a-95f296c91d76 for instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 on hv-cinder-85220 Aug 11 16:35:38.806350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-29e3fcb7-cba3-4f7a-bc87-698bc08dd903 req-6530ff78-5094-4b37-97b9-f596063c6623 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 Aug 11 16:35:38.807022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 456/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:35:39.478014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:39.480214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:39.487722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:39.488331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:39.488864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:39.489629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:39.490149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:39.490772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:39.526640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-77fdf299-2a08-4e78-9b7b-d56da047ef68 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052665 Aug 11 16:35:39.527463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 613/1069] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:39.601659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:39.602348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:39.610010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:39.610825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:39.611398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:39.612316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:39.612901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:39.613450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:39.677868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:39.686932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bb9c28c9-291c-4ac8-8b60-d77c94c7c949 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.089106 Aug 11 16:35:39.687503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 457/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:39 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:40.539496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:40.541572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:40.548585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:40.549066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:40.549498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:40.550185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:40.550639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:40.551057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:40.579700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f4030510-70e6-4559-85aa-547984d6e866 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044252 Aug 11 16:35:40.580260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 614/1071] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:40.707853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:40.708507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:40.714884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:40.715358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:40.715786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:40.716489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:40.716934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:40.717351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:40.779109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:40.787254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-27cc4418-73d2-430d-9f4d-87a983a39d05 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083256 Aug 11 16:35:40.787803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 458/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:40 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:41.592283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:41.594772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:41.602348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:41.602844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:41.603280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:41.603983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:41.604465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:41.604889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:41.635748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac053ad1-3b9f-4cb4-8e50-e80da82955da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047479 Aug 11 16:35:41.636245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 615/1073] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:41.808417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:41.809032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:41.816530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:41.817013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:41.817452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:41.818141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:41.818594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:41.819018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:41.879523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:41.887216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fa75656c-b864-4ab9-92e8-784678d5f816 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082721 Aug 11 16:35:41.887718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 459/1074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:41 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:42.648397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:42.650580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:42.657438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:42.657920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:42.658356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:42.659046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:42.659498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:42.659922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:42.689401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3da81ef-7baa-4380-abde-efafd5e96900 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045006 Aug 11 16:35:42.689945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 616/1075] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:42.907551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:42.908177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:42.914692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:42.915165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:42.915592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:42.916296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:42.917014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:42.917440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:42.981583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:42.989828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-437ea9b1-bf76-49c2-bec2-2b5c1e5662ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086727 Aug 11 16:35:42.990484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 460/1076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:42 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:43.701853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:43.704268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:43.710619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:43.711098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:43.711525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:43.712231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:43.712673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:43.713091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:43.742333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c122f821-5473-4cc2-bd33-2f4c0b552a2a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 Aug 11 16:35:43.742878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 617/1077] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:44.010596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:44.011142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:44.018222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:44.018705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:44.019139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:44.019837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:44.020329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:44.020757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:44.081812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:44.089365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6eaab1ec-047b-47b3-9111-2788f8facd9e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082765 Aug 11 16:35:44.089928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 461/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:44 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:44.755014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:44.757291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:44.763639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:44.764150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:44.765168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:44.765840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:44.766275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:44.766700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:44.795442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-73950781-9618-432b-8acf-27a36f0a3692 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044422 Aug 11 16:35:44.795990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 618/1079] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:45.111009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:45.111616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:45.118059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:45.118535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:45.118969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:45.119648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:45.120166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:45.120544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:45.182069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:45.190619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-904c28b9-671e-4816-8254-bfb0c6bfdb81 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083615 Aug 11 16:35:45.191181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 462/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:45 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:45.806979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:45.809213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:45.816434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:45.816918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:45.817352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:45.818036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:45.818486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:45.818998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:45.847948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6bf3485f-eefa-4e5b-bbcf-14e4c1b7c3ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044983 Aug 11 16:35:45.848524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 619/1081] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:46.211901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:46.212530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:46.220041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:46.220548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:46.220986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:46.221674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:46.222123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:46.222542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:46.283563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:46.291000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9955a8c2-692e-48f5-b869-ddc8191542e9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082925 Aug 11 16:35:46.291553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 463/1082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:46 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:46.861182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:46.863322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:46.869798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:46.870278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:46.870709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:46.871395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:46.871842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:46.872298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:46.901430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95c595f6-ec27-4edd-8953-f47c98b4512a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045130 Aug 11 16:35:46.901899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 620/1083] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:47.313359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:47.313969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:47.320419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:47.320899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:47.321330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:47.322015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:47.322466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:47.322915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:47.387152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:47.391919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:47.396994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9e5eb223-be5f-4431-a8d2-adaf508d55fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.089126 Aug 11 16:35:47.397552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 464/1084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:47 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:47.914102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:47.916273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:47.923569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:47.924056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:47.924516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:47.925208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:47.925659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:47.926082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:47.929838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:35:47.954725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f909f0a7-f60d-47cb-bc32-8159cd4d85fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044597 Aug 11 16:35:47.955271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 621/1085] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:48.417950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:48.418546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:48.424931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:48.425405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:48.425923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:48.426605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:48.427052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:48.427471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:48.487879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:48.495268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cb7b1758-bdb7-4833-b4e0-e203ec845a6b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081453 Aug 11 16:35:48.495823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 465/1086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:48 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:48.967100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:48.970013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:48.976459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:48.976938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:48.977372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:48.978090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:48.978541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:48.978959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:49.007873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7d742a95-9b3f-4a04-a635-a6a2956497c4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044825 Aug 11 16:35:49.008447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 622/1087] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:49.515184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:49.515789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:49.522199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:49.522674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:49.523105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:49.523779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:49.524259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:49.524671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:49.585351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:49.593353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-73313be0-8768-4445-ae15-35ec035cad41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082458 Aug 11 16:35:49.593910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 466/1088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:49 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:50.021125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:50.023291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:50.030331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:50.031139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:50.031854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:50.033043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:50.033811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:50.034513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:50.077745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49c9a777-4f4f-4ee4-9627-d0f7ed4e471b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060588 Aug 11 16:35:50.078298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 623/1089] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:50.614223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:50.614748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:50.621084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:50.621556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:50.621983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:50.622660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:50.623101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:50.623516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:50.687433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:50.694880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b164d4f0-24ea-43c4-939d-9ffcf398583a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084666 Aug 11 16:35:50.695435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 467/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:50 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:51.090186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:51.092366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:51.098801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:51.099290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:51.099728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:51.100452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:51.100907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:51.101333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:51.130715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-867c8806-ff8f-4441-a66a-996c1937aa74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044687 Aug 11 16:35:51.131270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 624/1091] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:51.715279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:51.715815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:51.722394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:51.722876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:51.723315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:51.724027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:51.724506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:51.724930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:51.787654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:51.795143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a33fe257-6fd6-4058-83da-f0ece5a8c7ca tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083853 Aug 11 16:35:51.795790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 468/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:51 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:52.143227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:52.145372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:52.151673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:52.152181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:52.152610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:52.153288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:52.153731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:52.154149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:52.182605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d58a206-c33e-4765-b4a0-8787e109802f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Aug 11 16:35:52.183145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 625/1093] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:52.816567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:52.817174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:52.823635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:52.824133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:52.824572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:52.825259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:52.825713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:52.826134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:52.888630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:52.896290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-59865905-9672-4c64-838f-c0cc24a93ba4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083540 Aug 11 16:35:52.896867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 469/1094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:52 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:53.195200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:53.197307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:53.204380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:53.204863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:53.205280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:53.205960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:53.206403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:53.206814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:53.235240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-977bea1d-860d-4df3-a25d-13a106e8fd43 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044055 Aug 11 16:35:53.235786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 626/1095] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:53.916862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:53.917502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:53.924876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:53.925357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:53.925792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:53.926484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:53.926937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:53.927365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:53.988829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:53.996316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a5f39a74-62bd-4f33-913d-12b9b7a87bad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083357 Aug 11 16:35:53.996881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 470/1096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:53 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:54.247584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:54.249714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:54.256079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:54.256586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:54.257015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:54.257695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:54.258138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:54.258554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:54.287609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-130f544f-680c-4667-9575-ba13439c1db7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044102 Aug 11 16:35:54.288159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 627/1097] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:55.017172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:55.017966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:55.025669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:55.026149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:55.026588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:55.027311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:55.027862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:55.028314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:55.090220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:55.097833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-24be61af-f1c1-41c3-a09b-1a21378df228 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085140 Aug 11 16:35:55.098394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 471/1098] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:55 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:55.300451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:55.302609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:55.309409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:55.309752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:55.310185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:55.310867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:55.312262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:55.312606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:55.340825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d825b160-2bf7-4f4c-b1bb-241cc68add8a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044974 Aug 11 16:35:55.341366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 628/1099] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:35:56.118695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:56.119309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:56.126614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:56.127096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:56.127532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:56.128243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:56.128696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:56.129127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:56.192775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:56.200235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a5b99f98-9d2d-477b-8ea1-3abe58df8e43 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085369 Aug 11 16:35:56.200797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 472/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:56 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:56.357462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:56.359545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:56.366087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:56.366561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:56.366991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:56.367671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:56.368166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:56.368584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:56.398910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ddb24e9c-df8d-41a0-a05a-926786a6108d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045533 Aug 11 16:35:56.399459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 629/1101] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:57.221687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:57.222293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:57.228713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:57.229205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:57.229631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:57.230307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:57.230748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:57.231163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:57.293163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:57.301640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-63e2931f-25d7-4552-871f-5f3463fdde78 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084002 Aug 11 16:35:57.302199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 473/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:57 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:57.411244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:57.413439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:57.419768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:57.420284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:57.421466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:57.422145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:57.422590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:57.423011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:57.452539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5c859a79-4a0e-4a16-b858-c02535f29e6c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Aug 11 16:35:57.453094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 630/1103] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:58.323129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:58.323658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:58.330856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:58.331337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:58.331772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:58.332490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:58.332940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:58.333363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:58.395591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:58.403172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-95eddef0-93ee-4077-9192-83963cfbd1d3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084078 Aug 11 16:35:58.403850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 474/1104] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:58 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:58.464780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:58.466898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:58.473720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:58.474189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:58.474614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:58.475288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:58.475730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:58.476196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:58.504416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dfdb46ac-b212-45fd-a9a5-f13add3e0b2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043640 Aug 11 16:35:58.504948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 631/1105] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:35:59.423591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:59.424299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:59.430715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:59.431195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:59.431630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:59.432339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:59.432792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:59.433219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:59.496881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:35:59.505118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eb0cbc91-c9ca-412f-90e6-68cdc064d706 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085430 Aug 11 16:35:59.505673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 475/1106] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:35:59 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:35:59.515861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:35:59.518023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:35:59.524429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:59.524902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:59.525332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:59.526011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:35:59.526457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:35:59.526875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:35:59.555011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-981b5ca9-fb73-489d-b3a9-7b5cd2ee5fbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043076 Aug 11 16:35:59.555550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 632/1107] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:35:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:00.525169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:00.525781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:00.532272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:00.532775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:00.533197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:00.533885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:00.534339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:00.534767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:00.567313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:00.569562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:00.576013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:00.576543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:00.577031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:00.577727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:00.578173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:00.578590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:00.598826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:00.606291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-85fb813b-46c3-4c8f-bcfe-1fa8e8329b41 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084971 Aug 11 16:36:00.606855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 476/1108] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:00 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:00.610377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-90ab2f82-1e31-4fb8-a421-a50e5bb818dd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046783 Aug 11 16:36:00.610947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 633/1109] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:36:01.622464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:01.625123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:01.627238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:01.627860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:01.631571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:01.632050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:01.632508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:01.633201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:01.633643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:01.634058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:01.634274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:01.634759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:01.635198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:01.635908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:01.636372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:01.636799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:01.663861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b445d16a-a4ce-40f7-814c-591822aa8b7c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045344 Aug 11 16:36:01.664446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 477/1110] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:01.698646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:01.706804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cfba7dac-795c-42b8-8be6-db35e376a542 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084123 Aug 11 16:36:01.707369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 634/1111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:01 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:02.676601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:02.678743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:02.684764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:02.685238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:02.685668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:02.686657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:02.687200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:02.687620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:02.716523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aaca1267-1801-4dec-b279-1e1648f770f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043999 Aug 11 16:36:02.717114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 478/1112] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:02.726917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:02.727537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:02.734473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:02.734950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:02.735384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:02.736072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:02.736548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:02.736972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:02.798260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:02.805622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66e61ae0-d913-4cba-93e0-6a4c03aef387 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082572 Aug 11 16:36:02.806181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 635/1113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:02 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:03.729758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:03.731871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:03.738918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:03.739391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:03.739823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:03.740544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:03.740993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:03.741414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:03.769772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d88d6a93-73bb-4cd2-82fd-52fcdb0195ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044186 Aug 11 16:36:03.770316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 479/1114] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:03.827270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:03.827897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:03.834513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:03.834986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:03.835418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:03.836114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:03.836574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:03.836990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:03.900218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:03.907954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7947293f-cc56-4405-b287-86021639551a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085168 Aug 11 16:36:03.908549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 636/1115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:03 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:04.783082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:04.785267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:04.787544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=61 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:04.793073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:04.793552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:04.793991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:04.794697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:04.795147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:04.795808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:04.824285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-44b244fa-5bca-455a-8d80-f513ef848c34 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046054 Aug 11 16:36:04.824835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 480/1116] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:04.928493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:04.929128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:04.931442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=63 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:04.937190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:04.937665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:04.938091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:04.938770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:04.939216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:04.939631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:05.000324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:05.003633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:05.008617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-087596f5-f4f6-4217-b0ed-5fd5174e977f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084042 Aug 11 16:36:05.009161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 637/1117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:04 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:05.836768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:05.838904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:05.846134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:05.846622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:05.847060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:05.847751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:05.848238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:05.848670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:05.865187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:05.878924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1bc3c2f5-2b68-487c-9ba2-4b122db650e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046179 Aug 11 16:36:05.879480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 481/1118] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:06.030578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:06.031194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:06.037911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:06.038409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:06.038845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:06.039548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:06.039997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:06.040450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:06.101531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:06.109056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bea59b5b-1b90-4cd5-aefa-956fe85844a8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082508 Aug 11 16:36:06.109619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 638/1119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:06 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:06.892638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:06.894691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:06.901108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:06.901591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:06.902025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:06.902710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:06.903155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:06.903575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:06.932480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-be68897a-ca2e-45ab-a1e5-000fc9c87cbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045000 Aug 11 16:36:06.933036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 482/1120] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:07.129027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:07.129636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:07.136335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:07.136811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:07.137242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:07.137920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:07.138363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:07.138778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:07.199740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:07.207452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9552c88b-978a-42dc-9da0-c69487ea4c1d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082312 Aug 11 16:36:07.208000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 639/1121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:07 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:07.946202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:07.948365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:07.955389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:07.955867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:07.956334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:07.957020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:07.957470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:07.957891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:07.986592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c7b7b15c-1ec5-483e-9d8b-ad69d840c2bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Aug 11 16:36:07.987135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 483/1122] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:08.227255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:08.227796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:08.234301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:08.234803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:08.235240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:08.235928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:08.236410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:08.236839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:08.301151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:08.308610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-309947a9-967a-4f44-8bf9-9d0264e08574 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085324 Aug 11 16:36:08.309172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 640/1123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:08 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:08.999500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:09.001664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:09.008019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:09.008529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:09.008962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:09.009642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:09.010084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:09.010498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:09.039853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a1965cf-aec6-4cf9-9268-49bbd58bc3f6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044952 Aug 11 16:36:09.040430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 484/1124] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:09.329198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:09.329811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:09.336629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:09.337117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:09.337551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:09.338242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:09.338721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:09.339172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:09.402383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:09.410356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48f6c9cf-c15f-4e4d-b272-972a8218761e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085125 Aug 11 16:36:09.410912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 641/1125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:09 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:10.052555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:10.054721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:10.061714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:10.062206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:10.062635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:10.063318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:10.063763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:10.064208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:10.093631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-27b20edb-0ac6-4885-ab68-996b80fdda41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045120 Aug 11 16:36:10.094178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 485/1126] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:10.431173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:10.431720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:10.438446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:10.438936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:10.439377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:10.440067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:10.440544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:10.440969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:10.501828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:10.509295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75938b4b-10e9-478b-8049-4c02e1621b60 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082135 Aug 11 16:36:10.509856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 642/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:10 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:11.106218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:11.108428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:11.114842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:11.115319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:11.115753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:11.116467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:11.116919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:11.117340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:11.146815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-25a335cd-2121-4267-b28a-1e726f277e96 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044734 Aug 11 16:36:11.147366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 486/1128] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:11.530250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:11.530871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:11.537224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:11.537703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:11.538133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:11.538812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:11.539280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:11.539696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:11.600020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:11.607365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-888dac40-f897-4f1f-ae53-e23b0810fd79 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081642 Aug 11 16:36:11.607946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 643/1129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:12.159568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:12.161749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:12.168126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:12.168613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:12.169042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:12.169816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:12.170305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:12.170766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:12.200192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eaf3b6f3-988f-422e-b84d-d05e4c5608a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Aug 11 16:36:12.200740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 487/1130] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:12.628657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:12.629276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:12.635746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:12.636270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:12.636711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:12.637400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:12.637856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:12.638283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:12.702086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:12.709581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cd026153-afb6-4814-a721-b37d98a3dbeb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084778 Aug 11 16:36:12.710138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 644/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:12 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:13.213269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:13.215416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:13.222682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.223168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.223605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.224321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.224773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.225197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.254581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-58a59e03-b93e-499c-af46-60f6219bf2f4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045384 Aug 11 16:36:13.255143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 488/1132] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:13.697430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:13.697977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:13.705801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.706292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.706734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.708317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.708785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.709212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.731324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:13.732080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:13.733605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-337a827d-7b4d-45c7-9c22-1176dfbd200e tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45/ips" status: 200 len: 150 microversion: 2.1 time: 0.039339 Aug 11 16:36:13.734352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 645/1133] 10.222.0.43 () {58 vars in 1248 bytes} [Thu Aug 11 16:36:13 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:36:13.740319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.740805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.741333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.742036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:13.742489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:13.742919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:13.815105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:13.822659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8a7d0b5c-da2b-44e1-850f-cf96f0fe9535 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.096513 Aug 11 16:36:13.823232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 489/1134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:14.267627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:14.269734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:14.275739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:14.276259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:14.276701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:14.277384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:14.277838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:14.278263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:14.306426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50f84305-9cd5-4483-82d8-4abc3d042fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043503 Aug 11 16:36:14.306964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 646/1135] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:14.843523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:14.844145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:14.850906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:14.851378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:14.851802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:14.852503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:14.852948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:14.853362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:14.918130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:14.925796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1133299d-818c-4172-ab84-d1fdd607c7d1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086844 Aug 11 16:36:14.926360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 490/1136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:14 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:15.319746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:15.321903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:15.328382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:15.328874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:15.329337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:15.330023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:15.330464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:15.330879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:15.359653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c6e9529-ce69-4cb6-b5e1-bfbe4fbcd918 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043342 Aug 11 16:36:15.360236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 647/1137] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:15.946717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:15.947327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:15.954744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:15.955220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:15.955653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:15.956362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:15.956838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:15.957260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:16.017910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:16.025424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ce5b5c24-0061-46e5-9299-232ce6465633 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082577 Aug 11 16:36:16.025988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 491/1138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:16.371386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:16.373972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:16.381184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:16.381662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:16.382095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:16.382778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:16.383223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:16.383641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:16.412336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fecbf09b-01af-4f9b-ab33-c77d99255860 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044739 Aug 11 16:36:16.412736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 648/1139] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:36:17.046434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:17.047320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:17.053922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:17.054410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:17.054852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:17.055549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:17.056003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:17.056456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:17.117544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:17.126143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2b3debc6-71d4-4d90-96bd-c1b0f0e2cbdd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082617 Aug 11 16:36:17.126707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 492/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:17.425434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:17.427620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:17.434056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:17.434538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:17.434971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:17.435661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:17.436132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:17.436822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:17.466606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f6c24c20-1465-4db0-a74c-4b0822bc7e1e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Aug 11 16:36:17.467154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 649/1141] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:18.147214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:18.147822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:18.154301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:18.154782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:18.155216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:18.156459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:18.157385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:18.157811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:18.220117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:18.227753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dbc2aa40-961f-4caa-ac22-904ca8c6e448 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084413 Aug 11 16:36:18.228352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 493/1142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:18 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:18.478985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:18.481073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:18.488171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:18.488653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:18.489089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:18.489779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:18.490237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:18.490657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:18.524381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a81a874b-0687-4764-aaec-68fff525e9f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049275 Aug 11 16:36:18.524946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 650/1143] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:19.248531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:19.249063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:19.255858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:19.256374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:19.256809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:19.257495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:19.257946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:19.258378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:19.328484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:19.335973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7891a308-6fc7-471b-94fc-99869f747e12 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.091490 Aug 11 16:36:19.336558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 494/1144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:19 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:19.537981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:19.540025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:19.547298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:19.547776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:19.548241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:19.548933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:19.549403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:19.549821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:19.580518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de554d57-c56e-49b5-8ff8-0c1fe52679d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047325 Aug 11 16:36:19.581447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 651/1145] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:20.357396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:20.357925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:20.364432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:20.364906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:20.365334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:20.366009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:20.366450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:20.366863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:20.431032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:20.443607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8451a2f7-897b-47b6-ba39-2aa56361ac15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.090167 Aug 11 16:36:20.444202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 495/1146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:20.593308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:20.595629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:20.602042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:20.602514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:20.602943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:20.603648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:20.604125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:20.604530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:20.633534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50a8b67a-936a-4058-80bf-8e0dcf89d3d7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044154 Aug 11 16:36:20.634005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 652/1147] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:21.465157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:21.465803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:21.473382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:21.474167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:21.474605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:21.475282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:21.475727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:21.476232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:21.536760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:21.544115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f9781e7-24bf-4640-a208-e49e76d78497 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082812 Aug 11 16:36:21.544678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 496/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:21.646578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:21.648735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:21.655260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:21.655804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:21.656402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:21.657107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:21.657558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:21.657985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:21.686312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60d4fc69-ec4b-4686-8eeb-7d585dd9f6a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043804 Aug 11 16:36:21.687627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 653/1149] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:22.565215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:22.565860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:22.572365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:22.572847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:22.573285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:22.573974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:22.574427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:22.574858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:22.635326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:22.643027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-efb3aace-9099-48a9-a5da-e093a78edb7a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082225 Aug 11 16:36:22.643592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 497/1150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:22.699101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:22.701729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:22.708765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:22.709249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:22.709683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:22.710373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:22.710827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:22.711249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:22.735904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:22.741028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95f3c1af-abd3-4484-aead-34f593a2ea0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045965 Aug 11 16:36:22.741579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 654/1151] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:23.664225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:23.664759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:23.671317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:23.672367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:23.672898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:23.673587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:23.674035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:23.674456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:23.678474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:23.739474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:23.747111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c421ba61-0fe1-4434-80e1-3746e2bebfbf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086917 Aug 11 16:36:23.747682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 498/1152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:23 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:23.754141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:23.756455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:23.763119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:23.763589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:23.764019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:23.764718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:23.765168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:23.765616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:23.794137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1aac76f0-eb3e-42c5-8b2b-ec2f1205f03f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044858 Aug 11 16:36:23.794674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 655/1153] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:24.769127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:24.769768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:24.776267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:24.776759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:24.777215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:24.777905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:24.778358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:24.778783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:24.807146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:24.809436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:24.816817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:24.817291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:24.817718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:24.818400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:24.818848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:24.819265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:24.839926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:24.848290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac1f6071-e6f6-41aa-99f6-d7705c80c640 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083723 Aug 11 16:36:24.848866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 499/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:24 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:24.848989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1026c34a-02d7-4c81-aef6-7b41dc17bfe5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046025 Aug 11 16:36:24.849519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 656/1155] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:36:25.861287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:25.864141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:25.868237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:25.868852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:25.870573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:25.871048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:25.871476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:25.872185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:25.872633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:25.873049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:25.875430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:25.875911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:25.876373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:25.877065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:25.877517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:25.877940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:25.903809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-46aad4cc-6b0a-4845-91b7-bd8991b0f778 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046556 Aug 11 16:36:25.904417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 500/1156] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:25.940540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:25.948123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f98ea8bb-90aa-4c79-839c-805b10a01079 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083778 Aug 11 16:36:25.948694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 657/1157] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:26.917181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:26.919341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:26.926955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:26.927434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:26.927868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:26.928584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:26.929043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:26.929466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:26.959848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d5d9d5e6-115a-4631-af46-a0a44e209127 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046734 Aug 11 16:36:26.960430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 501/1158] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:26.969778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:26.970384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:26.976771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:26.977248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:26.977675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:26.978352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:26.978800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:26.979216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:27.038671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:27.046410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7778bdde-e043-47cd-a5a5-06c8203c414f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081080 Aug 11 16:36:27.047684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 658/1159] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:26 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:27.972017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:27.974172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:27.980524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:27.980997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:27.981424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:27.982100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:27.982543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:27.982959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:28.012193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aa0ef094-d857-4335-b682-459238a7dcd1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Aug 11 16:36:28.012732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 502/1160] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:28.068490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:28.069126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:28.075091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:28.075576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:28.076019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:28.076751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:28.077208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:28.077635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:28.138116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:28.145651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68cbccc6-f585-4c1c-b60b-754c5a04eb2a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081292 Aug 11 16:36:28.146208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 659/1161] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:29.024907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:29.027021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:29.033558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:29.034042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:29.034479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:29.035169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:29.035622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:29.036053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:29.067623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3c7a0e2e-8a89-4ccc-a1f5-6700c9d26c64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046766 Aug 11 16:36:29.068204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 503/1162] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:29.166688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:29.167292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:29.174295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:29.174771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:29.175199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:29.175877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:29.176349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:29.176771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:29.242226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:29.249686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75e5aa19-1d9d-460c-9211-90cdecf721b2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086853 Aug 11 16:36:29.250233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 660/1163] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:29 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:30.079732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:30.081922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:30.088447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:30.088927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:30.089363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:30.090051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:30.090506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:30.090930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:30.120462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-81076f9a-7bcb-4fb9-b497-a9b516f59670 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Aug 11 16:36:30.121003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 504/1164] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:30.270999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:30.271558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:30.278070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:30.278543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:30.278968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:30.279641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:30.280087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:30.280529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:30.342364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:30.349752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55bd4688-4c12-4843-bde1-5a866366ddf9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082640 Aug 11 16:36:30.350308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 661/1165] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:30 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:31.132749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:31.134927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:31.141422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:31.141933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:31.142369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:31.143284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:31.143740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:31.144200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:31.172139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-10a46605-8ac3-421c-93d6-409839816bbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043383 Aug 11 16:36:31.172696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 505/1166] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:36:31.370043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:31.370659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:31.377199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:31.377862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:31.378299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:31.378987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:31.379439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:31.379891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:31.440589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:31.447993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c599d971-2231-42ad-94a8-853daa8c9f25 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081786 Aug 11 16:36:31.449211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 662/1167] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:32.184568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:32.186758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:32.193468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:32.193949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:32.194384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:32.195081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:32.195534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:32.195958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:32.225135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-225a1efa-87ff-43df-8d8c-c3e227f3312b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044592 Aug 11 16:36:32.225690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 506/1168] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:32.469324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:32.469875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:32.476914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:32.477399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:32.477825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:32.478514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:32.478961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:32.479382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:32.539838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:32.547162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-883281e3-a93a-4588-83ec-379802e0470f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081791 Aug 11 16:36:32.547714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 663/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:33.238004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:33.240173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:33.246905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:33.247407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:33.247858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:33.248564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:33.249010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:33.249427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:33.278614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc6db8ba-48ef-4ca6-9967-214fa125719c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045498 Aug 11 16:36:33.279165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 507/1170] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:33.568577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:33.569214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:33.575612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:33.576088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:33.576551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:33.577274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:33.577670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:33.578090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:33.640996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:33.649286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-854d71ea-0121-4f11-a096-3b48284202f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084794 Aug 11 16:36:33.649857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 664/1171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:33 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:34.290960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:34.293190 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:34.299758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:34.300286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:34.300726 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:34.301419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:34.301872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:34.302304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:34.332041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6b38a107-917c-4283-9af4-29baeec71948 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045049 Aug 11 16:36:34.332543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 508/1172] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:34.669735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:34.670260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:34.676857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:34.677334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:34.677761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:34.678441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:34.678895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:34.679308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:34.740093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:34.747551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70a9a8cc-a560-4d66-a00d-3a34f86caecf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081831 Aug 11 16:36:34.748113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 665/1173] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:34 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:35.344440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:35.346623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:35.348926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=58 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:35.354193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:35.354676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:35.355113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:35.355808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:35.356304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:35.356731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:35.386430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-25919396-f5d8-4731-a693-73de071f7b17 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046087 Aug 11 16:36:35.386981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 509/1174] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:35.767730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:35.768367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:35.770667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=58 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:35.775881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:35.776378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:35.776811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:35.777533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:35.777980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:35.778398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:35.842716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:35.850095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc1ea690-aff9-4258-a2c3-4555bf2cb823 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086421 Aug 11 16:36:35.850658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 666/1175] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:35 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:36.398989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:36.401219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:36.407531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:36.408033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:36.408754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:36.409437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:36.409883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:36.410297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:36.442298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-463ba089-eba5-4a86-acc6-586bcee430a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047370 Aug 11 16:36:36.442853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 510/1176] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:36.870489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:36.871094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:36.877484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:36.877960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:36.878387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:36.879066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:36.879512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:36.879926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:36.940888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:36.948281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2aa64ff6-d83a-4ef4-864d-bd530e75cab2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081633 Aug 11 16:36:36.948836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 667/1177] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:36 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:37.454162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:37.456337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:37.462786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:37.463269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:37.463707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:37.464437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:37.464892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:37.465319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:37.494763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a9dfbed3-bea2-4a46-a9d0-840a738cfe39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044673 Aug 11 16:36:37.495318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 511/1178] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:37.969428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:37.970040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:37.977236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:37.977722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:37.978159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:37.978849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:37.979302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:37.979832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:38.042338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:38.050029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6097b694-4722-4fab-8eba-81f6d8dc2bdc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084505 Aug 11 16:36:38.050587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 668/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:37 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:38.507559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:38.509825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:38.516328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:38.516810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:38.517764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:38.518516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:38.518975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:38.519401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:38.549401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-13ebdb00-a03b-442f-b435-a2ae25bace92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045302 Aug 11 16:36:38.549987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 512/1180] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:39.070990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:39.071595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:39.078076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:39.078553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:39.078980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:39.079658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:39.080784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:39.081260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:39.142949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:39.150640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-477156f4-2725-4cbd-b5a5-cce3adcd7088 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083491 Aug 11 16:36:39.151190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 669/1181] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:39 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:39.173013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:36:39.173251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:36:39.561498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:39.563954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:39.570971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:39.571448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:39.571884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:39.572600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:39.573051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:39.573474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:39.603807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0e0f24d9-2449-48eb-92d1-2c458477a2be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Aug 11 16:36:39.604318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 513/1182] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:40.171594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:40.172219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:40.179202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:40.179680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:40.180124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:40.180811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:40.181258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:40.181673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:40.242679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:40.250365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-499c38a2-0d00-49d2-9482-bd8728e55283 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082679 Aug 11 16:36:40.250923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 670/1183] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:40 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:40.616998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:40.619227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:40.625697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:40.626179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:40.627299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:40.628068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:40.628544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:40.628972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:40.653460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:40.658390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1ce92e9d-434b-4e0c-9177-07dade804d99 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Aug 11 16:36:40.658940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 514/1184] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:41.271182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:41.271790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:41.278547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:41.279016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:41.279449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:41.280236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:41.280700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:41.281136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:41.300618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:41.343627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:41.351984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ecc3d61-132d-4cdf-922e-665e57bb95a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084818 Aug 11 16:36:41.352575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 671/1185] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:41 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:41.670399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:41.672546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:41.680004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:41.680520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:41.680952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:41.681645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:41.682091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:41.682511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:41.712420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5f30b802-ae40-4e21-a3d5-91326cded709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046090 Aug 11 16:36:41.712970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 515/1186] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:42.373105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:42.373664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:42.380800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:42.381282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:42.381734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:42.382435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:42.382862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:42.383278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:42.453600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:42.461392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f88f9a89-59e6-4156-854a-528d3c6b8f53 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.092210 Aug 11 16:36:42.462039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 672/1187] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:42 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:42.725914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:42.728006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:42.734409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:42.734887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:42.735325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:42.737277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:42.737746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:42.738171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:42.766750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b805ef55-330a-4a75-bbac-d5a04928b13c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Aug 11 16:36:42.767775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 516/1188] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:43.481920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:43.482530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:43.489455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:43.489938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:43.490372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:43.491058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:43.491509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:43.491935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:43.772331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:43.778881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:43.779992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-de708bc0-d35d-409a-9cbf-b7067bd3189c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.301989 Aug 11 16:36:43.780578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 673/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:43 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:43.781081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:43.788337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:43.788816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:43.789243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:43.790267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:43.791062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:43.791819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:43.823718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fd0d052c-349b-4ba7-9a7a-b9258bee57ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048745 Aug 11 16:36:43.824298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 517/1190] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:36:44.803401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:44.804033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:44.810731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:44.811207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:44.811635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:44.812606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:44.813052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:44.813467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:44.834961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:44.837147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:44.843475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:44.843953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:44.844410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:44.845092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:44.846042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:44.846638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:44.874047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:44.878407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4d69f485-86e6-449c-9d35-8032b635f8db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Aug 11 16:36:44.878981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 518/1191] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:44.881864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b694dc37-0170-4682-bbec-8cca4b318496 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082256 Aug 11 16:36:44.882459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 674/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:44 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:45.891106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:45.893971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:45.900395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:45.900876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:45.901303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:45.902038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:45.902248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:45.902653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:45.902856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:45.902979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:45.909350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:45.909823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:45.910247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:45.910991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:45.911443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:45.911857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:45.933421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a5d4bcb-cb6c-4ec6-93ad-f957fb6861e2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046309 Aug 11 16:36:45.933981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 519/1193] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:45.973498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:45.980960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aeb91529-808c-4e3f-bf65-7ba067f757a4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082603 Aug 11 16:36:45.981521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 675/1194] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:45 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:46.946271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:46.948465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:46.955384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:46.955868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:46.956326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:46.957006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:46.957449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:46.957867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:46.987280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b6daf8ad-5a39-45f7-9c45-f891daefc734 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044648 Aug 11 16:36:46.987830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 520/1195] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:47.002282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:47.002891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:47.009223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:47.009696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:47.010165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:47.010849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:47.011294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:47.011711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:47.073359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:47.081623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-715f87c1-5b45-413a-ada6-1022201c699b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083339 Aug 11 16:36:47.082181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 676/1196] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:46 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:36:47.999539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:48.001718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:48.008140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:48.008617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:48.009047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:48.009721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:48.010162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:48.010576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:48.039194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f80430a1-41b2-4d7e-8a33-7203b0d8aa64 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Aug 11 16:36:48.039735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 521/1197] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:48.102092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:48.102728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:48.109155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:48.109628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:48.110057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:48.110736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:48.111372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:48.111794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:48.176152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:48.183598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-10459352-9ec2-45a5-ad5d-c8148cc105b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085388 Aug 11 16:36:48.184165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 677/1198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:48 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:49.051202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:49.053437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:49.060044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:49.060659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:49.061098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:49.061800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:49.062521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:49.062948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:49.092462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bda2eac6-35e8-4fea-ad61-28c565e12d03 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045469 Aug 11 16:36:49.093017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 522/1199] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:49.205250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:49.205993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:49.212407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:49.212882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:49.213312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:49.214043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:49.214436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:49.214852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:49.276974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:49.286185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9f0bc0fe-7bf3-4b08-bbd0-6f87f958a813 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084806 Aug 11 16:36:49.286740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 678/1200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:49 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:50.105437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:50.107582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:50.114265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:50.114740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:50.115176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:50.115860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:50.116338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:50.116764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:50.146182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-06bb1dff-c34a-49c5-a09c-e41faaafe647 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044754 Aug 11 16:36:50.146722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 523/1201] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:50.306472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:50.307013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:50.313846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:50.314330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:50.314802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:50.315498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:50.315943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:50.316383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:50.378882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:50.386367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fd1377cc-1ac3-4a7f-900a-10129157a1cf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083795 Aug 11 16:36:50.386917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 679/1202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:50 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:51.159294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:51.161448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:51.167867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:51.168365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:51.168795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:51.169472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:51.169914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:51.170331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:51.200694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f24cc8bb-8be3-4fd9-aa4f-090b2a42d1f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046195 Aug 11 16:36:51.201241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 524/1203] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:51.407613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:51.408249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:51.414796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:51.415275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:51.415704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:51.416436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:51.416882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:51.417298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:51.477518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:51.484986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75f41f33-f18b-4da1-85eb-838361fbd357 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081202 Aug 11 16:36:51.485547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 680/1204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:51 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:52.212997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:52.215131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:52.222307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:52.222772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:52.223199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:52.223871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:52.224338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:52.224758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:52.253541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-73a26b60-5631-4f1b-92da-29f38b25c6f2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Aug 11 16:36:52.254073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 525/1205] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:52.507044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:52.507587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:52.513488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:52.513959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:52.514383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:52.515328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:52.515779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:52.516221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:52.581833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:52.589326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76bd0661-b735-4468-9d0f-26872d9227bf tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087242 Aug 11 16:36:52.589879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 681/1206] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:52 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:53.265867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:53.268845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:53.275145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:53.275627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:53.276059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:53.276768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:53.277217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:53.277637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:53.305945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f19dd916-7377-4464-b315-76f83c742f51 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Aug 11 16:36:53.306546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 526/1207] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:53.609659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:53.610203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:53.617209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:53.617694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:53.618130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:53.618819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:53.619274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:53.619699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:53.680550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:53.688239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-70dedc7f-4309-4099-bd34-33e6ee8e75eb tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082465 Aug 11 16:36:53.688794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 682/1208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:53 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:54.318581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:54.320756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:54.327158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:54.327627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:54.328078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:54.328775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:54.329225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:54.329643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:54.358646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3f453b9e-66ca-41b0-a884-551a844bd701 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044137 Aug 11 16:36:54.359192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 527/1209] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:54.710002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:54.710537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:54.717272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:54.717767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:54.718193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:54.718880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:54.719330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:54.719751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:54.780158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:54.788257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e1edc06-dbdc-43fe-b630-e38ad07a17a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082857 Aug 11 16:36:54.788807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 683/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:54 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:55.371049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:55.373226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:55.380220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:55.380694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:55.381120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:55.381802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:55.382246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:55.382665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:55.414532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02985ee5-faab-4f11-a9c1-770c00925c21 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Aug 11 16:36:55.415317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 528/1211] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:55.809943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:55.809943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:55.816627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:55.817107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:55.817542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:55.818233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:55.818691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:55.819116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:55.881733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:55.889347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-23c43caa-7598-4609-8cca-979c9dc98c89 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084151 Aug 11 16:36:55.889921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 684/1212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:55 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:56.428227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:56.430374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:56.436768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:56.437245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:56.437929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:56.438615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:56.439060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:56.439478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:56.468259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-20853220-ecee-49fd-bf55-85bc6bec81cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044608 Aug 11 16:36:56.468809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 529/1213] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:56.911131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:56.911745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:56.918302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:56.918776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:56.919207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:56.919916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:56.920396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:56.920820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:56.987339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:56.994969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb3ec419-a1c9-440f-843a-94d2fb608873 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088573 Aug 11 16:36:56.995526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 685/1214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:56 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:57.480512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:57.482694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:57.489602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:57.490079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:57.490517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:57.491201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:57.491650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:57.492071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:57.520766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-be9ee332-4fe8-42f1-9e7a-5b59b864261e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044280 Aug 11 16:36:57.521313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 530/1215] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:58.016741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:58.017354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:58.023555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:58.024033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:58.024495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:58.025182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:58.025632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:58.026054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:58.086714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:58.094184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d81b3358-a84a-41d9-b8a1-e9f4c10ba460 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081389 Aug 11 16:36:58.094739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 686/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:58 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:58.533061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:58.535742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:58.542072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:58.542541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:58.542974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:58.543649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:58.544089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:58.544524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:58.561768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:36:58.575060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6bacf636-945b-4a19-855c-fac18df8f8c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046078 Aug 11 16:36:58.575608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 531/1217] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:36:59.115556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:59.116188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:59.122615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:59.123098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:59.123539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:59.124247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:59.124705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:59.125127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:59.185460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:36:59.194034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-775c3928-e7d5-409c-9810-45bdf8057d6d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083430 Aug 11 16:36:59.194592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 687/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:36:59 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:36:59.587341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:36:59.589504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:36:59.596067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:59.596589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:59.597052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:59.597732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:36:59.598177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:36:59.598623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:36:59.626958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eb11c8e5-11b2-48e7-96b4-918efaf758f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043623 Aug 11 16:36:59.628119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 532/1219] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:36:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:00.214742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:00.215382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:00.222976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:00.223455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:00.223885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:00.224662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:00.225111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:00.225534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:00.229537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:00.287657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:00.295219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ee34cf15-5217-4fff-89f9-293b8ebfdb4f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084342 Aug 11 16:37:00.295773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 688/1220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:00 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:00.639036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:00.641242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:00.648223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:00.648698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:00.649127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:00.649825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:00.650269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:00.650687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:00.678714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-45bf6992-ea88-4b14-b724-876cd5ee9dfa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043628 Aug 11 16:37:00.679180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 533/1221] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:01.317076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:01.317627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:01.324124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:01.324626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:01.325061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:01.325754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:01.326209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:01.326636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:01.390158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:01.398351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-01df4629-6387-4dbe-ac08-3041416e1247 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085811 Aug 11 16:37:01.398912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 689/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:01 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:01.691252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:01.693389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:01.699970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:01.700492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:01.700936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:01.701657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:01.702114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:01.702541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:01.732443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1d79878f-ff4b-4425-9d5e-398865a12af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045499 Aug 11 16:37:01.732993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 534/1223] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:02.419130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:02.419777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:02.426889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:02.427373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:02.427806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:02.428518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:02.428968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:02.429389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:02.490872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:02.498651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02a67473-2566-4aef-9403-0acc715956b9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083504 Aug 11 16:37:02.499215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 690/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:02 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:02.745298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:02.747412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:02.754727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:02.755206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:02.755641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:02.756358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:02.756807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:02.757229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:02.786252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-af64d603-bad6-401f-9f84-9e5e71bcbfea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044991 Aug 11 16:37:02.786796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 535/1225] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:03.520740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:03.521339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:03.527757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:03.528271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:03.528701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:03.529377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:03.529824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:03.530239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:03.590738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:03.598533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-57f18fef-9503-4e00-a32e-c854f9dee1be tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082212 Aug 11 16:37:03.599039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 691/1226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:03 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:03.798608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:03.801432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:03.807840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:03.808367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:03.808806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:03.809500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:03.809954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:03.810381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:03.840618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f819f51d-8294-4121-bbab-327f79150186 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045980 Aug 11 16:37:03.841176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 536/1227] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:04.619123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:04.619731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:04.626097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:04.626594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:04.627513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:04.628220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:04.628670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:04.629090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:04.691954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:04.699404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-292027ed-0552-4c47-884a-fb04748cfd86 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084142 Aug 11 16:37:04.699972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 692/1228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:04 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:04.852916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:04.855067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:04.861993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:04.862520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:04.862972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:04.863661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:04.864135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:04.864584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:04.893703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d89c81d0-09d6-40dc-95e2-bd964849055c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044741 Aug 11 16:37:04.894178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 537/1229] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:05.719767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:05.720362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:05.727481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:05.727968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:05.728437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:05.729153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:05.729686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:05.730112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:05.792965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:05.800435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc9a432a-b562-44f3-ad5d-a2ebaae4ad15 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084572 Aug 11 16:37:05.801000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 693/1230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:05 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:05.905358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:05.907486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:05.909910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=58 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:05.915048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:05.915527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:05.915964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:05.916677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:05.917129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:05.917575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:05.947526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2730fcb3-d2fc-4eb6-b74e-6bc0e21d9e05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046113 Aug 11 16:37:05.948063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 538/1231] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:06.821164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:06.821769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:06.824084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:06.829238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:06.829715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:06.830190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:06.831155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:06.831546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:06.831964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:06.892367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:06.900532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dff1b4cc-c4a8-4e22-a599-6deb8d2713a1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083225 Aug 11 16:37:06.901092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 694/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:06 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:06.960422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:06.962600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:06.969044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:06.969527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:06.969960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:06.970644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:06.971841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:06.972357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:07.000527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b351f43f-6865-4c72-a5ef-8ce1eb79c46f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Aug 11 16:37:07.001072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 539/1233] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:07.921895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:07.922645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:07.930031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:07.930529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:07.930950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:07.932233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:07.932725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:07.933148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:07.996691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:08.005761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6f076f7-0161-4284-a0e4-e8f8b0486142 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087800 Aug 11 16:37:08.008142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 695/1234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:07 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:08.013766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:08.016047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:08.022466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:08.022987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:08.023427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:08.024230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:08.024713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:08.025143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:08.056258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-57964701-eed4-4c95-99df-0c05fb3ab7bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046876 Aug 11 16:37:08.057090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 540/1235] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:09.026632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:09.027221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:09.034039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:09.034513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:09.034945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:09.035627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:09.036072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:09.036520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:09.069914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:09.072194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:09.078262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:09.078847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:09.079362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:09.080059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:09.081167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:09.081595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:09.098338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:09.105753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ec9be31-791f-4211-82b6-bbde06b28b07 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082982 Aug 11 16:37:09.106318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 696/1236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:09 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:09.111890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b75249fc-647c-4c57-bb7b-0c80ea4cacc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046354 Aug 11 16:37:09.112637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 541/1237] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:10.124120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:10.126193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:10.126596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:10.126800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:10.133234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:10.133390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:10.133713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:10.133835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:10.134143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:10.134248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:10.134829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:10.134938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:10.135276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:10.135382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:10.135693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:10.135792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:10.165885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e424599e-eb50-48b1-8a7a-04cd284fc7d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045783 Aug 11 16:37:10.166442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 697/1238] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:10.196829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:10.204264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9ec3f7ec-ee72-4e33-ba06-20d3d053b5a2 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081873 Aug 11 16:37:10.204818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 542/1239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:10 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:11.178391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:11.180582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:11.186963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:11.187456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:11.188174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:11.188856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:11.189301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:11.190227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:11.218936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e0a99d59-169e-4974-bbb8-40f5d9a8a39e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044521 Aug 11 16:37:11.219475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 698/1240] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:11.224981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:11.225608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:11.232119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:11.232608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:11.233037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:11.233714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:11.234159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:11.234575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:11.294796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:11.302544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cba09a8b-8afc-49c8-bcf1-5fc566ca12ee tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081444 Aug 11 16:37:11.303110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 543/1241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:12.231981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:12.234163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:12.240704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:12.241330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:12.241769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:12.242462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:12.242915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:12.243369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:12.272839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b2ac0e1e-d792-48cd-9cf9-4943248483bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Aug 11 16:37:12.273383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 699/1242] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:12.323761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:12.324333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:12.331466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:12.331950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:12.332420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:12.333113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:12.333567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:12.333994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:12.398150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:12.405804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-855c9a8c-9ac8-4495-9c3f-1e0437fae983 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086043 Aug 11 16:37:12.406371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 544/1243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:12 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:13.285587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:13.287724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:13.294486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.294964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.295389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.296077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.296547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.296962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.329118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0fd36450-5c65-401d-a8c6-0500a95d73eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047993 Aug 11 16:37:13.329659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 700/1244] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:13.428239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:13.428852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:13.435219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.435700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.436205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.436841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.437292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.437984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.504545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:13.511966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4e5430e5-7e9c-43bf-ba50-63acdaf99533 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.088745 Aug 11 16:37:13.512553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 545/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:13.806363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:13.806894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:13.813186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.813663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.814098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.815079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.815546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.815971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.840682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:37:13.915042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4fd72bb9-8ad1-4049-b663-dee75b783f54 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 204 len: 0 microversion: 2.1 time: 0.112279 Aug 11 16:37:13.915607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 701/1246] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:37:13 2022] DELETE /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:37:13.925108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:13.925741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:13.931825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.932371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.932803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:13.933480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:13.933925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:13.934341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:14.061179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:14.069370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8ae10149-30e3-4c06-ba10-9612da57c561 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1681 microversion: 2.1 time: 0.148582 Aug 11 16:37:14.069925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 546/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:13 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:14.342082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:14.344288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:14.350778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:14.351237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:14.351662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:14.352394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:14.352837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:14.353255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:14.382388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5842f7d2-36e7-4b66-8453-e61bd7418d14 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044724 Aug 11 16:37:14.382930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 702/1248] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:14.533298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:14.533909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:14.540528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:14.541006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:14.541435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:14.542121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:14.542566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:14.542986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:14.603585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:14.610991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-efe9dc60-47f9-4244-a5a5-212f8ba5b658 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081854 Aug 11 16:37:14.612065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 547/1249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:14 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:15.092020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:15.092663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:15.098804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.099287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.099725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.100447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.100901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.101327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.105474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:15.235937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:15.245702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bef85843-e4b1-4995-9032-bca01d7c7b5c tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1681 microversion: 2.1 time: 0.157301 Aug 11 16:37:15.246607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 703/1250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:15 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:15.395977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:15.398227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:15.404690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.405170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.405606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.406305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.406753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.407174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.411437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:15.438648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-816a3f3e-feac-45ea-ab9b-dabd66e3a260 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047886 Aug 11 16:37:15.439214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 548/1251] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:15.632055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:15.632609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:15.638975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.639465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.639903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.640628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:15.641084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:15.641508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:15.704275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:15.712260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-efe02d79-ae09-465f-872d-23bfae74cd3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084428 Aug 11 16:37:15.712831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 704/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:16.275240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:16.275846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:16.282232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.282707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.283137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.283814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.284293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.284716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.383954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e5b04101c1403d9b3a311803ac798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed4e8fe7284bd5863ba22aa552e60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:16.391787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a79e063d-ec89-4ae3-a125-1dadccd8b20d tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 200 len: 1613 microversion: 2.1 time: 0.120431 Aug 11 16:37:16.392382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 549/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:16 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:16.451160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:16.453287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:16.459802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.460320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.460753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.461439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.461886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.462303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.494216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-497a2ae8-8b92-4a1f-ad04-f02513d9fe11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047211 Aug 11 16:37:16.495018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 705/1254] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:16.610165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85b83f4-8ebf-41f4-9a1d-8186773c0c45", "name": "network-vif-deleted", "tag": "522aaee5-634f-4b7e-ad5a-95f296c91d76"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:37:16.622778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.623746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.625171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.642925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] Creating event network-vif-deleted:522aaee5-634f-4b7e-ad5a-95f296c91d76 for instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 on hv-cinder-85220 Aug 11 16:37:16.664959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-b054d173-ecdf-41ca-b4cd-6593419fd92c req-7f2b9549-a639-4890-8f64-5f9f766b68ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058486 Aug 11 16:37:16.667638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 550/1255] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:37:16.733531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:16.734253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:16.747754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.748286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.748721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.749713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:16.750266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:16.750697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:16.825258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:16.834942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1c5f91de-8d86-4397-9584-52e58cc9248b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.105107 Aug 11 16:37:16.835755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 706/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:16 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:17.031912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:17.033937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:17.042237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.042736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.043174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.044183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.044552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.044994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.414519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:17.415415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:17.421542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.422019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.422450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.423144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.423622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.424038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.440746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 HTTP/1.1 Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:17.443006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:17.444599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'd85b83f4-8ebf-41f4-9a1d-8186773c0c45'} Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:17.445526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:17.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:17.447928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:17.447928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7daaed91-5c34-4494-bbf7-19b71ab1f710 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 404 len: 111 microversion: 2.1 time: 0.034732 Aug 11 16:37:17.448952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 707/1257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:17 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:37:17.453088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2fcac105-2b25-4beb-9d9c-ee95f6265461 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '.version_select at 0x7f61435ac310>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:17.471710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2fcac105-2b25-4beb-9d9c-ee95f6265461 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716615196" status: 202 len: 0 microversion: 2.1 time: 0.022229 Aug 11 16:37:17.472480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 708/1258] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Aug 11 16:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716615196 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:37:17.506967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:17.509182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:17.516231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.516778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.517452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.518215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.518703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.520283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.554719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bf50f7a-c7a6-48d7-b790-2ac77e2bce02 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052747 Aug 11 16:37:17.559416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 709/1259] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:17.856886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:17.857569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:17.864574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.865118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.865619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.866383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:17.866901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:17.867392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:17.938505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:17.946521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-65107c04-da7f-4bcf-a7ee-aba29837afe9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.093579 Aug 11 16:37:17.947086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 710/1260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:18.140084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.140604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.147242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.147712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.148168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.148857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.149305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.149730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.163280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 HTTP/1.1 Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.164861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.166433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'd85b83f4-8ebf-41f4-9a1d-8186773c0c45'} Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.167334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.168813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.170188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.170188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f544c9c2-c854-4ad0-8f02-d520744a0dc8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 404 len: 111 microversion: 2.1 time: 0.030056 Aug 11 16:37:18.170188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 711/1261] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:37:18 2022] DELETE /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:37:18.174246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.174847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: d85b83f4-8ebf-41f4-9a1d-8186773c0c45] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.180873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.181348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.181786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.182473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.182924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.183344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.196750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 HTTP/1.1 Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.198239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.199746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'd85b83f4-8ebf-41f4-9a1d-8186773c0c45'} Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.200600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. Aug 11 16:37:18.202025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.203313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance d85b83f4-8ebf-41f4-9a1d-8186773c0c45 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.203313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-06e5dd2f-6084-408e-8b2d-42f65b294f6f tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45" status: 404 len: 111 microversion: 2.1 time: 0.028832 Aug 11 16:37:18.203313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 712/1262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:18 2022] GET /compute/v2.1/servers/d85b83f4-8ebf-41f4-9a1d-8186773c0c45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:37:18.208688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.209183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.214838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.215318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.215753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.216471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.216925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.217353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.231277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 HTTP/1.1 Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.232810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.234342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '364a5b7f-5bb8-405e-a07a-6256f38a1b38'} Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.235146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.236383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.237583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.237583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-089db284-9499-49b8-ba4c-7ce881fa2ea8 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 404 len: 111 microversion: 2.1 time: 0.030057 Aug 11 16:37:18.237583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 713/1263] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:37:18 2022] DELETE /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 16:37:18.242258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.242863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 364a5b7f-5bb8-405e-a07a-6256f38a1b38] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.248533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.249017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.249451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.250162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.250616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.251041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.264217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 HTTP/1.1 Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.265708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.267201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '364a5b7f-5bb8-405e-a07a-6256f38a1b38'} Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.268001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. Aug 11 16:37:18.269949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.271209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 364a5b7f-5bb8-405e-a07a-6256f38a1b38 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.271209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-131183c0-e844-4eec-bfc9-8cb7e6b46ae3 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38" status: 404 len: 111 microversion: 2.1 time: 0.028492 Aug 11 16:37:18.271209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 714/1264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:18 2022] GET /compute/v2.1/servers/364a5b7f-5bb8-405e-a07a-6256f38a1b38 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:37:18.275507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.275997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.281636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.282108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.282537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.283214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.283664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.284085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.297860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 HTTP/1.1 Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.299350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.301415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '5283c193-adba-4892-a6a7-9f9db4233735'} Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.302331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.303757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.305213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.305213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8caeec31-342f-4a99-b01d-20c5491876e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 404 len: 111 microversion: 2.1 time: 0.028774 Aug 11 16:37:18.305213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 715/1265] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:37:18 2022] DELETE /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:37:18.309469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.310077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 5283c193-adba-4892-a6a7-9f9db4233735] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.315914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.316520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.316907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.317592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.318044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.318469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.331530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 HTTP/1.1 Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:37:18.333838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.335367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '5283c193-adba-4892-a6a7-9f9db4233735'} Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:37:18.336259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. Aug 11 16:37:18.337690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:37:18.338916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 5283c193-adba-4892-a6a7-9f9db4233735 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:37:18.338916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e7ec0f2e-7fc5-4890-b530-ebfeb95b2f35 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735" status: 404 len: 111 microversion: 2.1 time: 0.029178 Aug 11 16:37:18.338916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 716/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:18 2022] GET /compute/v2.1/servers/5283c193-adba-4892-a6a7-9f9db4233735 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:37:18.567123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.569295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.575286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.575760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.576212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.576891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.577336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.577752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.607131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c645b888-953a-4581-b6ff-68f8dd2a5bfe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Aug 11 16:37:18.607672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 717/1267] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:18.968124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:37:18.969343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:18.970151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:18.978075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.978565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.979730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:18.986143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:18.986672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:18.987271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:19.053244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:19.061987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0893d4e3-d6b3-4cf4-b6d4-50b3d961e642 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.098577 Aug 11 16:37:19.063116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 718/1268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:18 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:19.621688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:19.623829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:19.629793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:19.630265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:19.630697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:19.631374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:19.631819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:19.632266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:19.661451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f81fee9c-fb1e-46ab-84ba-4dfa862a42d4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043704 Aug 11 16:37:19.661973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 719/1269] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:20.085272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:20.085879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:20.092265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:20.092740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:20.093169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:20.093845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:20.094289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:20.094707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:20.154795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:20.162256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cac1689b-af5b-4298-8924-51e5e5f28e77 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081479 Aug 11 16:37:20.162807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 720/1270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:20.673953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:20.676580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:20.682807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:20.683278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:20.683707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:20.684433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:20.684963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:20.685383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:20.716158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6d75644e-2b72-40e4-ba01-7bc43185852c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046325 Aug 11 16:37:20.716720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 721/1271] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:21.183312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:21.184074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:21.192069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:21.192579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:21.193017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:21.193716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:21.194201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:21.194625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:21.271764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:21.279452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f27c297-06bc-4360-a2a8-1476788c9343 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.100227 Aug 11 16:37:21.280015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 722/1272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:21.728324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:21.730441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:21.736443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:21.736919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:21.737348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:21.738061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:21.738699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:21.739125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:21.767859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-672de58e-ec5f-4ccb-b2ce-b6d5c986e406 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043816 Aug 11 16:37:21.768438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 723/1273] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:22.299050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:22.299700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:22.306126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:22.306599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:22.307072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:22.307700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:22.308166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:22.308585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:22.369361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:22.376800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aff87646-0034-489c-85fa-741f4d616d0e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081598 Aug 11 16:37:22.377358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 724/1274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:22 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:22.781123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:22.783259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:22.789419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:22.789900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:22.790334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:22.791020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:22.791476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:22.791890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:22.808621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:22.824022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82a7f69a-34c3-4528-bc6f-d6411ae71aeb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046808 Aug 11 16:37:22.824813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 725/1275] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:23.398078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:23.398723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:23.405294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:23.405778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:23.406213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:23.406901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:23.407353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:23.407777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:23.471773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:23.479815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4275ec34-b082-494a-977b-07e2fff16bc3 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086128 Aug 11 16:37:23.480404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 726/1276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:23 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:23.838217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:23.840404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:23.846332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:23.846802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:23.847400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:23.847960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:23.848436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:23.848850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:23.879103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f86cef6-37de-4c58-9faf-f2213d2031a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Aug 11 16:37:23.879692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 727/1277] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:24.499909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:24.500602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:24.507049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:24.507532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:24.507965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:24.508686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:24.509138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:24.509563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:24.573007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:24.580536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cd72d235-02bf-4a61-8e56-f0fa0798be92 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084419 Aug 11 16:37:24.581089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 728/1278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:24 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:24.891211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:24.893566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:24.899947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:24.900457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:24.900884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:24.901562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:24.902007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:24.902421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:24.930486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8395ceac-be9d-4af9-984f-4ab9fe9c2e69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 Aug 11 16:37:24.931028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 729/1279] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:25.601548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:25.602152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:25.608507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:25.608986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:25.609418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:25.610103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:25.610553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:25.610975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:25.674626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:25.682922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38f15e91-1dcc-41dd-b529-743eac0c8de8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085814 Aug 11 16:37:25.683480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 730/1280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:25 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:25.943698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:25.945778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:25.952198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:25.952374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:25.952762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:25.953443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:25.953885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:25.954302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:25.982890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f7545884-2aae-43de-95c9-4f9a1f45b57d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043823 Aug 11 16:37:25.983426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 731/1281] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:26.703537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:26.704279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:26.711250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:26.711731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:26.712209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:26.712898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:26.713349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:26.713771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:26.774661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:26.782148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51986aa3-df0a-45f9-a6b2-05b209c211f9 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082465 Aug 11 16:37:26.782697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 732/1282] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:26 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:26.995075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:26.997354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:27.006104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:27.006585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:27.007020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:27.007712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:27.008205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:27.008654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:27.038420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69f6d36e-cbe0-4bdb-b4d8-a41046f36c15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047224 Aug 11 16:37:27.038934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=27 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:27.039401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 733/1283] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:27.803252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:27.803905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:27.809936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:27.810420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:27.810858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:27.811548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:27.812004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:27.812457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:27.873567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:27.882235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44c6c044-f8eb-41aa-b660-95c719931d1a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083098 Aug 11 16:37:27.882810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 734/1284] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:27 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:28.051732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:28.053940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:28.059963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:28.060481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:28.060921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:28.061614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:28.062069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:28.062497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:28.094762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff4db24e-3a1f-49ab-a6cd-0c2437e47fe3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047712 Aug 11 16:37:28.095310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 735/1285] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:28.902678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:28.903332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:28.910281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:28.910769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:28.911215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:28.911888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:28.912366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:28.912787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:28.974900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:28.977557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=20 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:28.982624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc9480ad-b4c7-46cf-89cb-2a6ad74705b8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083776 Aug 11 16:37:28.983181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 736/1286] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:28 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:29.107177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:29.109329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:29.115923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:29.116437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:29.116863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:29.117537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:29.117980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:29.118400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:29.146622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8fcc6655-8021-4c3c-aa6f-cc72ccf1a301 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043385 Aug 11 16:37:29.147155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 737/1287] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:30.003760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:30.004448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:30.010774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:30.011273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:30.011700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:30.012419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:30.012866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:30.013283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:30.077622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:30.086092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9af5f9ae-0ed3-4316-b46f-bdc88d352c50 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086404 Aug 11 16:37:30.086648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 738/1288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:29 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:30.158564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:30.161507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:30.167411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:30.167894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:30.168367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:30.169111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:30.169564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:30.169989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:30.198596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1fe9f070-a5dd-4a3a-b1a9-61e2e69b1d88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043755 Aug 11 16:37:30.199145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 739/1289] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:31.107778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:31.108440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:31.110733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:31.116732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:31.117217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:31.117654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:31.118347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:31.118802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:31.119227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:31.180851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:31.188630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bab9991-1f66-4bfb-935a-99d185bcdac1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084438 Aug 11 16:37:31.189214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 740/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:31 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:31.210469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:31.212631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:31.218450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:31.218924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:31.219356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:31.220040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:31.220518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:31.220943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:31.249913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a73f17c0-288e-40f0-a779-d95c99261e9b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043228 Aug 11 16:37:31.250481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 741/1291] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:37:32.210235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:32.210851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:32.217320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:32.217798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:32.218230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:32.218918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:32.219367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:32.219789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:32.223796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:32.281823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:32.289491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ace94082-9345-4d99-ae0f-3622bc2077ad tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083684 Aug 11 16:37:32.290064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 742/1292] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:32 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:32.294542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:32.296682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:32.302406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:32.302877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:32.303305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:32.303982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:32.304455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:32.304873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:32.333925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-45e42d96-2af6-4efc-95f9-538614854af4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042827 Aug 11 16:37:32.334397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 743/1293] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:33.310186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:33.310837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:33.317914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:33.318394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:33.318821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:33.319498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:33.319961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:33.320395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:33.382551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:33.389966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f512def9-b9c6-4d66-8d87-200339bed9bd tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083724 Aug 11 16:37:33.390514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 744/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:33 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:33.395528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:33.397653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:33.403381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:33.403856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:33.404315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:33.404999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:33.405445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:33.405858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:33.434548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e02a98d2-9afc-4e13-b288-7f2bd473f59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043059 Aug 11 16:37:33.435085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 745/1295] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:34.410290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:34.410952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:34.417308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:34.417773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:34.418202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:34.418885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:34.419329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:34.419746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:34.483234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:34.490787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8a7a531-b6a3-4803-bbb4-83b01449864e tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084332 Aug 11 16:37:34.491332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 746/1296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:34 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:34.495785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:34.497907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:34.503924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:34.504469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:34.504923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:34.505601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:34.506044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:34.506458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:34.534981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c1ed7130-9d4e-48b9-9117-fa635006a6e9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042683 Aug 11 16:37:34.535502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 747/1297] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:35.512061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:35.512712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:35.519638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:35.520191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:35.520686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:35.521365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:35.521806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:35.522221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:35.582453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:35.589781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f98e346-c7dd-4e0d-8b14-b4becf1ba465 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081587 Aug 11 16:37:35.590333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 748/1298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:35 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:35.594764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:35.596890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:35.603212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:35.603680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:35.604128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:35.604809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:35.605253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:35.605714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:35.633631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c75cfb58-7496-43b5-9536-24349fa62a5c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042334 Aug 11 16:37:35.634161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 749/1299] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:36.610758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:36.611405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:36.618364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:36.618844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:36.619276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:36.619962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:36.620443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:36.620866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:36.682028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:36.689818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cdb98a5f-b336-433e-ab63-9378ac4719de tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082949 Aug 11 16:37:36.690378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 750/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:36 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:36.696088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:36.698236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:36.704006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:36.704624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:36.705088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:36.705775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:36.706249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:36.707425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:36.735632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-297a3f35-edfb-417c-bd4a-7595120c9a5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043114 Aug 11 16:37:36.736196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 751/1301] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:37.711449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:37.712341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:37.718591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:37.719071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:37.719504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:37.720254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:37.720740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:37.721166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:37.783837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:37.792079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ad4deed-1d00-430e-a681-fbd5af281c37 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084683 Aug 11 16:37:37.792663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 752/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:37 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:37.797236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:37.799404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:37.805138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:37.805620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:37.806051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:37.806741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:37.807195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:37.807621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:37.836329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80571993-a444-43ab-8880-ef3c4e8c0e2d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042615 Aug 11 16:37:37.836866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 753/1303] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:38.812974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:38.813874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:38.821341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:38.821821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:38.822254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:38.822937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:38.823424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:38.823848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:38.888270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:38.896865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e393bae-db32-4656-9e7f-718dbbe5f3fc tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.087815 Aug 11 16:37:38.897418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 754/1304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:38 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:37:38.902056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:38.904234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:38.909959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:38.910438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:38.910866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:38.911546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:38.911993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:38.912439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:38.940381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af446ad9-e9dc-4970-99ba-4aa0cde49e92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041958 Aug 11 16:37:38.941491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 755/1305] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:39.917361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:39.917991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:39.924288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:39.924762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:39.925226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:39.926053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:39.926504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:39.926926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:39.988321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:39.995889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f2a9b24-b699-4124-aa84-c5720da30b54 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082458 Aug 11 16:37:39.996469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 756/1306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:39 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:40.000991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:40.003123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:40.008958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:40.009432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:40.009858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:40.010540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:40.010988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:40.011429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:40.040238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86207412-4788-4f62-ae68-20375daee7fa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042758 Aug 11 16:37:40.040784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 757/1307] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:41.016447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:41.017121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:41.024007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:41.024512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:41.024938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:41.025614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:41.026540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:41.026540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:41.087832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:41.091224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:41.095990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ab5044b-d293-4f8c-81a8-6ff602aab377 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083404 Aug 11 16:37:41.096577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 758/1308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:41 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:41.101091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:41.103196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:41.108973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:41.109446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:41.109870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:41.110543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:41.110983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:41.111395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:41.139455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf19eef6-b597-4bf0-a69e-7bf148957002 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041882 Aug 11 16:37:41.139985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 759/1309] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:42.117536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:42.118137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:42.124615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:42.125089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:42.125516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:42.126196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:42.126643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:42.127065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:42.190031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:42.198431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc5d34da-8791-43fe-bf3b-86f6f22e4774 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084737 Aug 11 16:37:42.198992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 760/1310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:42 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:42.203436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:42.205547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:42.211571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:42.212056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:42.212523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:42.213218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:42.213700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:42.214125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:42.242785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f8a1d05-763d-415d-8548-d173571d4da4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042821 Aug 11 16:37:42.243327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 761/1311] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:43.219172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:43.219800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:43.226831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:43.227313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:43.227739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:43.228464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:43.228909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:43.229324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:43.293714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:43.301565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1bd17146-bef9-442c-84b7-a9ec118ceb6f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086597 Aug 11 16:37:43.302122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 762/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:43 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:43.306635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:43.308711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:43.314473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:43.314941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:43.315365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:43.316712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:43.317158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:43.317573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:43.346030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85ad1757-95f0-4b4f-ab18-967241b2ba86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Aug 11 16:37:43.346560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 763/1313] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:44.322605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:44.323255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:44.329683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:44.330157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:44.330580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:44.331795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:44.332552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:44.332977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:44.392618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:44.400559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76b41ade-a1b2-4d18-8bf7-a48e47cd7136 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081951 Aug 11 16:37:44.401111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 764/1314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:44 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:44.405705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:44.407810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:44.414088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:44.414567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:44.414995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:44.415677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:44.416141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:44.416562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:44.446264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-385aa45d-8896-436f-88e4-ba48171a16ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Aug 11 16:37:44.446812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 765/1315] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:45.421830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:45.422446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:45.429560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:45.430038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:45.430468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:45.431152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:45.431601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:45.432028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:45.493391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:45.500803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-05ccdbf5-f2f2-4f9b-ad1d-4473d6a2b6c7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082906 Aug 11 16:37:45.501364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 766/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:45 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:45.506330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:45.508482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:45.514265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:45.514744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:45.515177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:45.515865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:45.516355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:45.516807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:45.545982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44bd63ed-c11f-48f4-99be-9fb4994c3690 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043642 Aug 11 16:37:45.546530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 767/1317] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:46.521843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:46.522489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:46.528842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:46.529321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:46.529753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:46.530439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:46.530887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:46.531339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:46.594910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:46.603333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-719df035-19aa-40dc-a160-68b63a868c30 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085928 Aug 11 16:37:46.603893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 768/1318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:46 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:46.608427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:46.610546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:46.616513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:46.616992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:46.617425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:46.618112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:46.618559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:46.618983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:46.647834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22e7f034-e8fd-48e3-822e-82194cc976c9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042945 Aug 11 16:37:46.648408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 769/1319] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:47.623609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:47.624285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:47.631594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:47.632075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:47.632533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:47.633217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:47.633671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:47.634094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:47.697893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:47.705399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-373c25e3-9408-4e88-b0a7-51fc340e6670 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085685 Aug 11 16:37:47.705957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 770/1320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:47 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:47.710484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:47.712625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:47.718212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:47.718690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:47.719122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:47.719807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:47.720291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:47.720710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:47.750038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c6d675d-8577-49f9-b26b-ede864473709 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043096 Aug 11 16:37:47.750587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 771/1321] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:48.726760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:48.727434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:48.733787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:48.734270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:48.734704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:48.735388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:48.735837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:48.736301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:48.798502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:48.806759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a667684d-55a2-4d3b-bd6e-83066e7cbc19 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084874 Aug 11 16:37:48.807322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 772/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:48 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:48.811855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:48.814257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:48.820152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:48.820631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:48.821059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:48.821742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:48.822184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:48.822597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:48.852397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-925bcb17-cb5a-4574-b6ea-346dca19d2b8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044057 Aug 11 16:37:48.852952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 773/1323] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:49.828047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:49.828704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:49.835755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:49.836272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:49.836704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:49.837393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:49.837842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:49.838266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:49.898858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:49.906395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a0d5605-43a4-481e-8c88-7e626f22e28b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082251 Aug 11 16:37:49.906956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 774/1324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:49 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:49.912014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:49.914184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:49.919734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:49.920307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:49.920741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:49.921429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:49.921878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:49.922297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:49.938420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:49.951889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36c64a91-9abd-42a8-9bec-42dc5665158f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043975 Aug 11 16:37:49.952476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 775/1325] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:50.926851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:50.927640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:50.933940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:50.934412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:50.934845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:50.935537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:50.935982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:50.936422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:50.998982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:51.007192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44bfe637-8f9c-4f8b-98e3-8a75cd2a4461 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084311 Aug 11 16:37:51.007754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 776/1326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:50 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:51.012254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:51.014395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:51.020701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:51.021179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:51.021608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:51.022295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:51.022779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:51.023198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:51.052081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f3fe8b6f-2b69-46f2-8766-98fdc39285ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 Aug 11 16:37:51.052670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 777/1327] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:52.028210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:52.028909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:52.035872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:52.036382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:52.036817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:52.037504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:52.037957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:52.038380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:52.103204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:52.110687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24cd94b6-b5ca-4c51-8dbe-ebc434a772b6 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086645 Aug 11 16:37:52.111250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 778/1328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:52 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:52.116921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:52.119044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:52.124811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:52.125310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:52.125765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:52.126448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:52.126891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:52.127306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:52.155804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bad53742-9905-46ee-ba98-82ceaeca1a7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 Aug 11 16:37:52.156385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 779/1329] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:53.132090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:53.132739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:53.139240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:53.139724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:53.140183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:53.140873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:53.141332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:53.141757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:53.202720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:53.210462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b56b1e15-5b40-4a0f-a8b5-5900bced21b5 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082306 Aug 11 16:37:53.211028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 780/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:53 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:53.215529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:53.217652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:53.223720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:53.224222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:53.224652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:53.225328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:53.225774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:53.226194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:53.254474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb7b0f25-196a-4f6f-9592-2de831cd0aa0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042466 Aug 11 16:37:53.255014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 781/1331] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:54.231031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:54.231747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:54.238379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:54.238860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:54.239291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:54.239978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:54.240455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:54.240875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:54.303433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:54.311023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c48209b5-d912-42a3-ba7a-1230a4086900 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084011 Aug 11 16:37:54.311524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 782/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:54 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:54.316729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:54.318857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:54.324505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:54.324987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:54.325424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:54.326111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:54.326562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:54.326983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:54.356490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6c87691e-c8c8-429d-9b08-8280a18a8976 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043942 Aug 11 16:37:54.357037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 783/1333] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:55.332183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:55.332842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:55.339255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:55.339737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:55.340199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:55.340900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:55.341356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:55.341781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:55.405762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:55.414080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b96a7050-7682-491c-8e89-4f589a254a4b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085826 Aug 11 16:37:55.414650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 784/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:55 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:55.419209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:55.421415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:55.427823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:55.428340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:55.428777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:55.429466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:55.429920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:55.430343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:55.458989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a4e1ea49-efb8-40b2-a073-c18b9b443941 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043350 Aug 11 16:37:55.459535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 785/1335] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:56.434956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:56.435603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:56.443267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:56.443747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:56.444205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:56.444897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:56.445346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:56.445767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:56.509965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:56.517455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f520b16e-3f3b-4f3d-9060-17c71ec86d00 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.086473 Aug 11 16:37:56.518009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 786/1336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:56 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:56.523277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:56.525574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:56.531234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:56.531716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:56.532182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:56.532881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:56.533342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:56.533769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:56.562530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbb6030e-7f1d-48d7-a51e-97fa1606f5fb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042994 Aug 11 16:37:56.563077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 787/1337] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:57.539088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:57.539712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:57.546168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:57.546639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:57.547069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:57.547748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:57.548224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:57.548645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:57.695427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:57.702966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-52f44f3a-fc1f-4cf5-87cf-acec6bd28ff4 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.167787 Aug 11 16:37:57.703516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 788/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:57 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:57.708154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:57.710271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:57.715804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:57.716321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:57.716980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:57.717661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:57.718108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:57.718524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:57.747653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-788f68e3-0fdb-45b4-ade4-58c12c6bec86 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043165 Aug 11 16:37:57.748218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 789/1339] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:58.723692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:58.724390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:58.726147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:58.731571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:58.732086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:58.732542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:58.733224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:58.733666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:58.734078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:58.795040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:58.803212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1336aba2-288f-4308-ab9e-7439dee1ace0 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083787 Aug 11 16:37:58.803774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 790/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:58 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:58.808241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:58.810344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:58.817075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:58.817550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:58.817979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:58.818656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:58.819102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:58.819515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:58.852148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2a24845a-c1ec-41c2-b90f-218a997fcd0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047318 Aug 11 16:37:58.852698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 791/1341] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:37:59.825178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:59.825848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:59.832917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:59.833399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:59.833833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:59.834520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:59.834971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:59.835393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:59.839438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:37:59.897054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:37:59.904616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6f67446-0498-4f1b-be8f-f3675558c333 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083349 Aug 11 16:37:59.905177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 792/1342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:37:59 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:37:59.910060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:37:59.912298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:37:59.917844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:59.918321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:59.918778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:59.919475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:37:59.919927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:37:59.920391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:37:59.950497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5225d016-7c1c-419a-afac-24586d7325a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044340 Aug 11 16:37:59.951250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 793/1343] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:37:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:00.925525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:00.926196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:00.932638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:00.933116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:00.933543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:00.934224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:00.934669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:00.935121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:00.998559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:01.006261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6692e0e5-aacb-436e-9a45-69dd88e39863 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084658 Aug 11 16:38:01.006813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 794/1344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:00 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:01.011287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:01.013432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:01.019025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:01.019504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:01.019933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:01.021228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:01.021627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:01.022045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:01.051263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51c51dcc-a692-4194-a5a8-78422631bb9e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043431 Aug 11 16:38:01.052181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 795/1345] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:02.026532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:02.027234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:02.033548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:02.034025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:02.034452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:02.035129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:02.035572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:02.036015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:02.097915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:02.105534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2554f7dc-93a3-4447-a88a-28f2c3471bef tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082930 Aug 11 16:38:02.106091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 796/1346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:02 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:02.110625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:02.112777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:02.118540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:02.119029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:02.119468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:02.120197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:02.120686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:02.121115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:02.150388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-73d9ca8d-da8e-41da-8b8d-374fde5d496b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043326 Aug 11 16:38:02.150931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 797/1347] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:03.125891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:03.126542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:03.133046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:03.133537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:03.133973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:03.134664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:03.135120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:03.135546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:03.196190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:03.203681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68f1d543-207c-43dc-ae30-08d1f76311f8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.081691 Aug 11 16:38:03.204491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 798/1348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:03 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:03.209594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:03.211744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:03.218257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:03.218743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:03.219237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:03.220092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:03.220604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:03.221035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:03.250833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36f6fab9-a771-4273-bedb-2065357d3d23 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045531 Aug 11 16:38:03.251385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 799/1349] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:04.226212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:04.226991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:04.233503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:04.234030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:04.234718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:04.235551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:04.236111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:04.236538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:04.298102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:04.306305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ae12174-e4cf-44fa-abe1-c087f643354a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084381 Aug 11 16:38:04.306937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 800/1350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:04 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:04.311708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:04.314131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:04.319894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:04.320409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:04.320847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:04.321541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:04.321993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:04.322417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:04.352856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc56811d-f4bb-40a0-b149-c470472e994a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044993 Aug 11 16:38:04.353407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 801/1351] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:05.326737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:05.327339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:05.333872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:05.334343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:05.334770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:05.335443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:05.335891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:05.336347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:05.399959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:05.407871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b6b5be24-d3ba-426d-8ba1-a0b8049c0bc7 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085109 Aug 11 16:38:05.408456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 802/1352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:05 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:05.412993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:05.415097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:05.420690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:05.421164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:05.421592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:05.422269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:05.422714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:05.423130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:05.453220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55d5a559-2f86-417a-817d-567a0d3e7bf6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 Aug 11 16:38:05.453760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 803/1353] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:06.428691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:06.429340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:06.435644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:06.436155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:06.436596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:06.437301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:06.437754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:06.438179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:06.498772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:06.506814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69cd5e4c-d0bb-4fa9-bf09-6d3a56c97e64 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.082323 Aug 11 16:38:06.507380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 804/1354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:06 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:06.511871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:06.514044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:06.519753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:06.520970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:06.521578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:06.522265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:06.522713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:06.523132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:06.552241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d43a10fe-dbcb-481b-ac39-b452e3e1492d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043600 Aug 11 16:38:06.552796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 805/1355] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:07.526878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:07.527487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:07.533928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:07.534411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:07.534852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:07.535548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:07.536563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:07.537010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:07.597887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:07.606244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-537fb8a1-de9e-493f-a83f-255bf69b4a3a tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083281 Aug 11 16:38:07.606828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 806/1356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:07 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:07.616689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:07.616689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:07.619856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:07.620370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:07.620811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:07.621550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:07.621955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:07.622378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:07.651532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4996670c-5198-4306-901e-b7c92eb21693 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043715 Aug 11 16:38:07.652075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 807/1357] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:08.627854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:08.628530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:08.635698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:08.636209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:08.636646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:08.637339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:08.637790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:08.638211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:08.699874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:08.703390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:38:08.708551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22df7b88-44d9-423c-8f89-fad04c96af40 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084510 Aug 11 16:38:08.709118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 808/1358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:08 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:08.713958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:08.716185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:08.721801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:08.722276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:08.722718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:08.723935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:08.724587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:08.725020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:08.755755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b185121-4b6f-4965-8235-9664f125a8ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Aug 11 16:38:08.756343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 809/1359] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:09.729091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:09.729688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:09.736001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:09.736505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:09.736932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:09.737608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:09.738053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:09.738468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:09.802190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:09.810433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67e9f2f4-f610-4963-aa08-81cd8075102f tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085254 Aug 11 16:38:09.810994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 810/1360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:09 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:09.815789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:09.817991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:09.824602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:09.825089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:09.825526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:09.826255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:09.826712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:09.827141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:09.856324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2930f9fc-e541-4f65-898a-6284ebcef5d3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044323 Aug 11 16:38:09.856875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 811/1361] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:10.832082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:10.832776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:10.840329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:10.840806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:10.841239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:10.841922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:10.842373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:10.842793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:10.904732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:10.913496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04561927-d724-4588-9698-8c07e1840901 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085270 Aug 11 16:38:10.914039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 812/1362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:10 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:10.918611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:10.920752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:10.926325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:10.926800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:10.927499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:10.929111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:10.929567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:10.929989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:10.960186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e28c714-58c0-444c-862d-54fe7b167f5a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045120 Aug 11 16:38:10.960740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 813/1363] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:11.934202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:11.934862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:11.941503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:11.941983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:11.942416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:11.943659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:11.944129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:11.944553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:12.006736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:12.014135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67f9947b-bedc-440f-8139-a2cd60de5f7c tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083843 Aug 11 16:38:12.014696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 814/1364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:11 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:12.019248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:12.022492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:12.028367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:12.028851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:12.029284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:12.029973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:12.030424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:12.030844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:12.060643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9edb9aa4-32bb-4e20-ade6-ef19b82467c2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Aug 11 16:38:12.061200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 815/1365] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:13.034753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:13.035456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:13.042534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:13.043017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:13.043453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:13.044170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:13.044623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:13.045047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:13.107795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:13.115273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2093e6bd-3c10-4d45-9775-f7a389d181e1 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.084394 Aug 11 16:38:13.115834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 816/1366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:13 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:13.120367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:13.122493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:13.128341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:13.128816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:13.129270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:13.129952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:13.130502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:13.130951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:13.161331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-db4a4148-efdd-4a91-9d0a-6892010d6845 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Aug 11 16:38:13.162458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 817/1367] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:14.136770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:14.137479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:14.143840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:14.144357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:14.144794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:14.145478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:14.145929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:14.147081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:14.211135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:14.218851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc34d3d1-018c-4805-a82d-09ffb899d1ab tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085989 Aug 11 16:38:14.219412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 818/1368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:14 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:14.224068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:14.226392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:14.232539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:14.233213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:14.233582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:14.234522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:14.234998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:14.235424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:14.264792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-31f9c175-5a80-4673-b65d-cc88fb2c7c38 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Aug 11 16:38:14.265341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 819/1369] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:14.315011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:38:14.315186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:38:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:38:15.240870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:15.241549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:15.248068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:15.248570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:15.249000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:15.249677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:15.250122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:15.250536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:15.312826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:15.321963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbf6a97a-59b5-4236-8d46-a01039a0821d tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.085483 Aug 11 16:38:15.322524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 820/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:15 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:15.327232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:15.329371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:15.335175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:15.335652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:15.336081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:15.336781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:15.337228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:15.337641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:15.366651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7ba6311f-2de6-4d99-8861-9d1a7576f86f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043136 Aug 11 16:38:15.367183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 821/1371] 10.222.0.43 () {60 vars in 1343 bytes} [Thu Aug 11 16:38:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:38:16.342664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:16.343312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:16.350397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:16.350880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:16.351313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:16.352010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:16.352489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:16.352916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:16.413677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:38:16.421702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f60968d-e36a-4926-9d70-5298b7f89294 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.083024 Aug 11 16:38:16.422499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 822/1372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:38:16 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:38:16.496134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:38:16.498432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:16.504790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:16.505314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:16.505846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:16.506584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:16.507044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:16.507474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:16.584779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d0da1994-f071-4ced-9a13-eda7e8945d27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action" status: 200 len: 37794 microversion: 2.20 time: 0.155524 Aug 11 16:38:16.585436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 823/1373] 10.222.0.43 () {62 vars in 1319 bytes} [Thu Aug 11 16:38:16 2022] POST /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558/action => generated 37794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:38:17.160681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:38:17.161356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:38:17.168962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:17.169537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:17.169979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:17.170710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:38:17.171160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:38:17.171583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:38:27.166567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=69 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:38:27.190692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=92 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:38:43.011880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:38:43.012532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e (ip 10.222.0.43) !!! Aug 11 16:39:17.174399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-937703b3-f920-47b5-8b82-11977bd73178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 202 len: 0 microversion: 2.1 time: 120.149353 Aug 11 16:39:17.177239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 551/1374] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:37:17 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 0 bytes in 120153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 16:39:17.183544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:39:17.184263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:39:17.190919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:17.191403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:17.191834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:17.192585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:17.193035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:17.193543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:17.286599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:39:17.294607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-34f4e786-2f2e-47c7-b2ae-b52350262032 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1224 microversion: 2.1 time: 0.116064 Aug 11 16:39:17.295185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 552/1375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:39:17 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:39:17.299864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:39:17.300793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:39:17.307025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:17.307505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:17.307945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:17.308668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:17.309147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:17.309561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:17.513762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:39:19.127467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:39:19.155979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:39:19.158285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:39:19.159976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:39:19.161855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:39:19.164960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:39:19.166440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:39:19.167691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) Aug 11 16:39:19.169347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:39:19.170629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5355cf71-619e-49e9-ba4f-c9aaa0c85218) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:39:19.170629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-035019ea-c646-4e24-acb8-17cc45414412 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 62.073157 Aug 11 16:39:19.170629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 824/1376] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:38:17 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 62075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 16:39:19.170629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:39:19.170997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:39:19.173693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:19.174177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:19.174771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:19.175292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:39:19.175748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:39:19.176213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:39:27.305279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=4 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:39:29.133446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:39:29.171005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:39:29.195284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=8 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:39:59.184060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:39:59.184626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e (ip 10.222.0.43) !!! Aug 11 16:41:17.764040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:41:17.767021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:41:17.769307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:41:17.770502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:41:17.772062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:41:17.774022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:41:17.775267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) Aug 11 16:41:17.776872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:41:17.780197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2c08ec10-0eff-4121-bf70-7109dcc927ed) {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:41:17.780197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7ee3de63-4dbb-4eab-88e5-ed2397575391 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 120.472508 Aug 11 16:41:17.780197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 553/1377] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:39:17 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 120474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:41:17.847949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:41:17.848507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:41:17.856179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:17.856677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:17.857105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:17.857810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:17.858261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:17.858690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:17.884426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:41:17.891925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:41:17.934788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.compute.api [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Instance is already in deleting state, ignoring this request Aug 11 16:41:17.935759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-14e7e863-4244-4a15-8ea6-4d5dfe642918 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.164201 Aug 11 16:41:17.936372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 554/1378] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:41:17 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:41:17.941395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:41:17.942184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:41:17.947808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:17.948346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:17.948790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:17.949695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:17.950282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:17.950756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:19.359455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8912c570-7306-4326-b754-1db52428bfeb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3" status: 202 len: 0 microversion: 2.1 time: 120.197419 Aug 11 16:41:19.360261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 825/1379] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:39:19 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 => generated 0 bytes in 120199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 16:41:19.367094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:41:19.367661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:41:19.374575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:19.375048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:19.375746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:19.376488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:41:19.376976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:41:19.377589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:41:19.394892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:41:27.945317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=4 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:41:29.371661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:41:29.398115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:41:29.414455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:41:34.325657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:41:34.326176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:41:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 (ip 10.222.0.43) !!! Aug 11 16:41:52.633391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:41:52.633954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e (ip 10.222.0.43) !!! Aug 11 16:42:03.020258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:42:03.020906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e (ip 10.222.0.43) !!! Aug 11 16:43:03.775294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:43:03.775843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 (ip 10.222.0.43) !!! Aug 11 16:43:18.375353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:18.511263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:43:18.513490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:18.514908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:18.515820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:18.517163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.518352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:18.519363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) Aug 11 16:43:18.520515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.521622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-404758d4-9a9b-4193-8267-1e5675258888) {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:18.521622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6bca12c8-1e42-43a7-8617-c35e56e3c771 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 120.577621 Aug 11 16:43:18.521622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 555/1380] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:41:17 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 120579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:18.521622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:18.521932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:18.527768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.528353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.528806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.529594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.529935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.530363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.557717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:43:18.615713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.compute.api [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Instance is already in deleting state, ignoring this request Aug 11 16:43:18.616585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7590dfc4-682b-4119-9a3c-b4eb9bafd359 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.100143 Aug 11 16:43:18.617264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 556/1381] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:18 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:43:18.621969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:18.622340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:18.628336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.628829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.629258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.630140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.630595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.631018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.898401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Request method failure captured: Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 HTTP/1.1 Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S6Z-9KTwRt6RmjwUev7-nT77NIIhj-ZaWT7oOpyh5CDZjs2aguk-pjWc-IR8GUUvS0Tnf8ZqWfTosPIh7vJ5C8v9GBXGGAOcCh4_MseC9v4wFbM4TmOMV0aBI6xCL1WXhDOtxkOoOiHv1Qf7NdbCXzABpqdt8qcCOytrv8Rx8Nl9gQ Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:18.900686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92e71ba59c6d42dabeef49f62cebac1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}] Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 992a34be52b7491da0b68cbe17f25b39 Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:18.902094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '984554e8-81f8-42e6-b2a5-3067ea1b1ad0', 'id': '951a47cd-1ac0-4257-8e1d-c0fbf84a86f3'} Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:18.903003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:18.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.905315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:18.906344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) Aug 11 16:43:18.908718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:18.910511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-651ef4cd-6b5b-442b-ac0a-2d94e475c4c4) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:18.910511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4b562e6-885f-4f12-8ebf-6f9127d2eaf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3" status: 400 len: 269 microversion: 2.1 time: 119.540866 Aug 11 16:43:18.910511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 826/1382] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:41:19 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 => generated 269 bytes in 119542 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:18.910511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:18.910879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:18.917350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.917841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.918243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.918927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:18.919368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:18.919784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:18.989058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:19.193401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:43:19.193586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e (ip 10.222.0.43) !!! Aug 11 16:43:19.741764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:19.774307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:43:19.778696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:19.780013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:19.780682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:19.781710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.783893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:19.784963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) Aug 11 16:43:19.786091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.787116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f98f4745-542e-4eae-a6c5-465872bf97d3) {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:19.787116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4f915214-e3a0-4db5-bd59-d00d2d689e38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 1.161973 Aug 11 16:43:19.787116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 557/1383] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:18 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 1163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:19.789796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:19.794993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:19.800589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.800589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.800589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.801047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.801918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.802354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.821278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Request method failure captured: Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 HTTP/1.1 Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S6Z-9KTwRt6RmjwUev7-nT77NIIhj-ZaWT7oOpyh5CDZjs2aguk-pjWc-IR8GUUvS0Tnf8ZqWfTosPIh7vJ5C8v9GBXGGAOcCh4_MseC9v4wFbM4TmOMV0aBI6xCL1WXhDOtxkOoOiHv1Qf7NdbCXzABpqdt8qcCOytrv8Rx8Nl9gQ Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:19.824613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92e71ba59c6d42dabeef49f62cebac1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}] Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 992a34be52b7491da0b68cbe17f25b39 Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:19.825987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '984554e8-81f8-42e6-b2a5-3067ea1b1ad0', 'id': '951a47cd-1ac0-4257-8e1d-c0fbf84a86f3'} Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:19.826608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:19.827623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.828782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:19.829864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) Aug 11 16:43:19.831049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:19.833350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:43:19.834480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d820494c-310d-4c79-adb4-3780ec815a22) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:19.835580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf3c992c-ea4f-43a1-92de-2e0fa3f9eded tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3" status: 400 len: 269 microversion: 2.1 time: 0.931815 Aug 11 16:43:19.836398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 827/1384] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:18 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 => generated 269 bytes in 933 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:19.841543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:19.842564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:19.849705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.850191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.850619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.851306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.851748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.852185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.922110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7fd99fcc-2700-4b8f-9d1e-5b0512d5bf0b tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.139646 Aug 11 16:43:19.922722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 558/1385] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:19 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:43:19.939308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:19.939308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:19.939308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.939308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.939639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.939639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:19.939639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:19.939639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:19.981794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:20.019634 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:20.048976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.051150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:20.052527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.053370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.054842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.056032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.060337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) Aug 11 16:43:20.062741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.064884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93b71b26-8e7a-4660-8991-0f6205125e4b) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.064884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-325a07ed-ffa9-41fa-b28f-9b4b935d936c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 0.215121 Aug 11 16:43:20.064884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 828/1386] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:19 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:20.064884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.065410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.065561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.066013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.066444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.067142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.067589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.068010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.086840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Request method failure captured: Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 HTTP/1.1 Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S6Z-9KTwRt6RmjwUev7-nT77NIIhj-ZaWT7oOpyh5CDZjs2aguk-pjWc-IR8GUUvS0Tnf8ZqWfTosPIh7vJ5C8v9GBXGGAOcCh4_MseC9v4wFbM4TmOMV0aBI6xCL1WXhDOtxkOoOiHv1Qf7NdbCXzABpqdt8qcCOytrv8Rx8Nl9gQ Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:43:20.089168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92e71ba59c6d42dabeef49f62cebac1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}] Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 992a34be52b7491da0b68cbe17f25b39 Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:20.090579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '984554e8-81f8-42e6-b2a5-3067ea1b1ad0', 'id': '951a47cd-1ac0-4257-8e1d-c0fbf84a86f3'} Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.091243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.092299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.093455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.094516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) Aug 11 16:43:20.096553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.097585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b02293a-5ff7-4176-8e12-851beaffea6f) {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.097585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e4dc7e33-852a-40c9-8aee-b472333713f9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3" status: 400 len: 269 microversion: 2.1 time: 0.165995 Aug 11 16:43:20.097585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 559/1387] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:19 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:20.097585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.097879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.098912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:43:20.103502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.103980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.104656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.105698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.106016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.106449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.153544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.compute.api [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Instance is already in deleting state, ignoring this request Aug 11 16:43:20.154569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6ae3dc44-3feb-4aed-8f75-9af1b3d029d8 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.099817 Aug 11 16:43:20.155465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 829/1388] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:43:20.162378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.162877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.169551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.170039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.170538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.171247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.171702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.172151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.193413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'services' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:20.251183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lazy-loading 'services' on Instance uuid 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:20.280341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e HTTP/1.1 Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:43:20.282519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 16:43:20.284077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'server_id': '655956a1-b46b-46ea-9b5a-88a98e9618b6', 'id': 'c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e'} Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.285160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.286959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.288568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.290440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) Aug 11 16:43:20.292134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.294844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-455df66d-3057-445c-af48-d2d349a8100a) {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.294844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-332dd440-73f4-4603-a575-989f1dab7e62 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e" status: 400 len: 269 microversion: 2.1 time: 0.191921 Aug 11 16:43:20.294844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 560/1389] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments/c4b8d243-fe62-467c-9f2b-e3fbd0a42b8e => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:20.294844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.295212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.297592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.298749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.299177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.299869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.300369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.300788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.317952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Request method failure captured: Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 HTTP/1.1 Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S6Z-9KTwRt6RmjwUev7-nT77NIIhj-ZaWT7oOpyh5CDZjs2aguk-pjWc-IR8GUUvS0Tnf8ZqWfTosPIh7vJ5C8v9GBXGGAOcCh4_MseC9v4wFbM4TmOMV0aBI6xCL1WXhDOtxkOoOiHv1Qf7NdbCXzABpqdt8qcCOytrv8Rx8Nl9gQ Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.320186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92e71ba59c6d42dabeef49f62cebac1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92e71ba59c6d42dabeef49f62cebac1d"}]}] Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 92e71ba59c6d42dabeef49f62cebac1d Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-347925014 Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 992a34be52b7491da0b68cbe17f25b39 Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-VolumesSnapshotTestJSON-347925014-project Aug 11 16:43:20.321772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '984554e8-81f8-42e6-b2a5-3067ea1b1ad0', 'id': '951a47cd-1ac0-4257-8e1d-c0fbf84a86f3'} Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.322508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5143, in _detach_volume Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 16:43:20.323733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.325195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5165, in detach_volume Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5145, in _detach_volume Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.326473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) Aug 11 16:43:20.327858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.330833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04b9c1c1-a82c-4ee4-85b9-a8c9b6d05706) {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.330833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c34e1c8a-5510-4107-8616-91eed2d5e376 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3" status: 400 len: 269 microversion: 2.1 time: 0.164934 Aug 11 16:43:20.331024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:43:20.331186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 830/1390] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0/os-volume_attachments/951a47cd-1ac0-4257-8e1d-c0fbf84a86f3 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:43:20.332021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.332021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.338006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.338492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.339016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.339747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.340220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.340634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.358241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 HTTP/1.1 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.360028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.362572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '7fca7c34-392f-431f-8ba3-191be7a54e10'} Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.363597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.365092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.369132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.370585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8ebb9cf7-6bc5-46dd-8f80-53e9e577239c tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 404 len: 111 microversion: 2.1 time: 0.041070 Aug 11 16:43:20.375319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 831/1391] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:43:20.381662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.382817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.386035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.compute.api [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Instance is already in deleting state, ignoring this request Aug 11 16:43:20.386876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-019051ee-8e13-42fa-b6a5-90ed3926e5ed tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 204 len: 0 microversion: 2.1 time: 0.101534 Aug 11 16:43:20.391230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 561/1392] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:43:20.393495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.394220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.394932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.395803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.396434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.397008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.397215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.399469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.415556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.415556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.415556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.415556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.415991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.415991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.418734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 HTTP/1.1 Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.420457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.421881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '96bfca9f-d7bf-443a-9d7e-70b0774da2b0'} Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.423935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.425238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.428508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.428508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-460c52a5-d3d4-4be5-bfda-2e5035cf36e5 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 404 len: 111 microversion: 2.1 time: 0.045228 Aug 11 16:43:20.428508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 832/1393] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:43:20 2022] DELETE /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:43:20.432278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.432923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] [instance: 7fca7c34-392f-431f-8ba3-191be7a54e10] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.442687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.443239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.443395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1c0d90e1-b7e0-4b2d-99c3-c1fe9c8b50b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050533 Aug 11 16:43:20.443682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.444675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.445134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.446516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.448603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 562/1394] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:20.453655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.455599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.462328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.462821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.463262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.463987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.464556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.465083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.467686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] HTTP exception thrown: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Request method failure captured: Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 HTTP/1.1 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4S7Tdz9lX-63XDFri5gT3vzc6OWwEshAzRgN-3QnU70t6nMAqwJ5PhWpjun1LAu4b0oJ3c5Obp2_TG1PPUua3IAqhYBMRjzBIQAz4XB8-5h50OBaqcpGT_to7AixYlPjigSlAfSu_YwML-C29FbKN9UhB6HzITrVsdfpcnrFg2Eu8 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.470866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d15983e6d8e4ad6887105f88f187044", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d15983e6d8e4ad6887105f88f187044"}]}] Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 6d15983e6d8e4ad6887105f88f187044 Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2129530583 Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 3a5ab962b58f473f874bd94bfe2db6b3 Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeTestJSON-2129530583-project Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.472373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '7fca7c34-392f-431f-8ba3-191be7a54e10'} Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.473156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. Aug 11 16:43:20.474374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.475441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] Returning 404 to user: Instance 7fca7c34-392f-431f-8ba3-191be7a54e10 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.475441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2923e02f-5738-49bd-a0ee-1816352d6660 tempest-AttachVolumeTestJSON-2129530583 tempest-AttachVolumeTestJSON-2129530583-project] 10.222.0.43 "GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10" status: 404 len: 111 microversion: 2.1 time: 0.043542 Aug 11 16:43:20.475441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 833/1395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:43:20 2022] GET /compute/v2.1/servers/7fca7c34-392f-431f-8ba3-191be7a54e10 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:43:20.479519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:20.480161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] [instance: 96bfca9f-d7bf-443a-9d7e-70b0774da2b0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:20.487829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.488368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.488797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.489507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.490023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.490524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.501719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:20.502369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:20.502899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:20.503458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lazy-loading 'fault' on Instance uuid b79e2fbc-243f-414d-a640-f814f64e7947 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:43:20.509613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] HTTP exception thrown: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Request method failure captured: Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 HTTP/1.1 Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4hhRaIesLLeynrUAi3XINAGWiToeIdmZ1tHWF6sA8DhzMEUhpHoCK4wqTXoGIIs_Ro-sPNd30IsOaJXag3OifioaPsVffQiIC0HnIyfMua0vlKrrE9FMQF4hah-5__V0otTIJ5I9BuQjXVPh6POrpzMpFIfYYSw8nfd04NF1B_x0U Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:43:20.511151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_91ed4e8fe7284bd5863ba22aa552e60b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/91ed4e8fe7284bd5863ba22aa552e60b"}]}] Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 91ed4e8fe7284bd5863ba22aa552e60b Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1264438055 Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: e7e5b04101c1403d9b3a311803ac798f Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeNegativeTest-1264438055-project Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.512854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '96bfca9f-d7bf-443a-9d7e-70b0774da2b0'} Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:20.513683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. Aug 11 16:43:20.515124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:43:20.517034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] Returning 404 to user: Instance 96bfca9f-d7bf-443a-9d7e-70b0774da2b0 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:20.517034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-646d2049-738a-4819-8df9-38dadd124741 tempest-AttachVolumeNegativeTest-1264438055 tempest-AttachVolumeNegativeTest-1264438055-project] 10.222.0.43 "GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0" status: 404 len: 111 microversion: 2.1 time: 0.040236 Aug 11 16:43:20.517034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 834/1396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:43:20 2022] GET /compute/v2.1/servers/96bfca9f-d7bf-443a-9d7e-70b0774da2b0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:43:20.554561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2b7595ca6d446c84e95a05a701e9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c02c8d1fa4a9fbbb64a655643ff31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:43:20.566106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3101cedb-ac52-49af-8b15-e0c10d905f58 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 200 len: 1189 microversion: 2.1 time: 0.116143 Aug 11 16:43:20.566440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 563/1397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:43:20 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 1189 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:43:21.456624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:21.458821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:21.466286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:21.466780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:21.467214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:21.467922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:21.468398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:21.468823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:21.502757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ffb20795-4c1f-4fed-97d6-81d3a443603c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050393 Aug 11 16:43:21.503331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 835/1398] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:21.589416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:21.590031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] [instance: b79e2fbc-243f-414d-a640-f814f64e7947] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:21.597062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:21.597544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:21.597982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:21.598799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:21.599282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:21.599708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:21.616010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] HTTP exception thrown: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Request method failure captured: Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 HTTP/1.1 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S5vLfUDpANEX4Twv3xVa8_dMoQ-lft0t1fyJXEq-lXg8rd4Fp8QpJXE1dVZrEjeZOEyrCnKLSrCynsvw6mIOwZ24vZ1IIJ7MDjXEOcSfpTya1LDLf1XKSfpVV3hwAIAdGkTlVfO43AQmJI9VLnHeAmNU4ytesG5zDEurdGgZlPyxBc Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: ab0c02c8d1fa4a9fbbb64a655643ff31 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-TestVolumeBootPattern-1921281785 Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:43:21.617586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab0c02c8d1fa4a9fbbb64a655643ff31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab0c02c8d1fa4a9fbbb64a655643ff31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab0c02c8d1fa4a9fbbb64a655643ff31", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab0c02c8d1fa4a9fbbb64a655643ff31"}]}] Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-TestVolumeBootPattern-1921281785 Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: ab0c02c8d1fa4a9fbbb64a655643ff31 Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-TestVolumeBootPattern-1921281785 Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-TestVolumeBootPattern-1921281785-project Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: ea2b7595ca6d446c84e95a05a701e9dc Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-TestVolumeBootPattern-1921281785-project Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. Aug 11 16:43:21.619088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'b79e2fbc-243f-414d-a640-f814f64e7947'} Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:43:21.623831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. Aug 11 16:43:21.625472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:43:21.628531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Returning 404 to user: Instance b79e2fbc-243f-414d-a640-f814f64e7947 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:43:21.628531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7ddf522a-ee19-43be-b702-b2ad30227976 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947" status: 404 len: 111 microversion: 2.1 time: 0.033776 Aug 11 16:43:21.628531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 564/1399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:43:21 2022] GET /compute/v2.1/servers/b79e2fbc-243f-414d-a640-f814f64e7947 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 16:43:22.515417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:22.518561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:22.526077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:22.526761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:22.527528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:22.528434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:22.529056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:22.529485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:22.567299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-93874173-cd4c-44ce-b904-62db2b063652 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055452 Aug 11 16:43:22.572687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 836/1400] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:23.582218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:23.586712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:23.612656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:23.615107 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:23.617794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:23.621316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:23.622369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:23.623053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:23.738060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4cf2a804-7cb0-4058-ac14-ca018fb7166d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161883 Aug 11 16:43:23.745112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 565/1401] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:24.754447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:24.757417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:24.765361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:24.767870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:24.768354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:24.769063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:24.769520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:24.769939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:24.804570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-61a64d44-664d-42f9-b6c1-d40e52d9c296 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056435 Aug 11 16:43:24.805314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 837/1402] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:25.819782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:25.822980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:25.843553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:25.844277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:25.845181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:25.849793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:25.851888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:25.852599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:25.920564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e0131290-b760-45b5-9058-f1ce00c9c3dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105706 Aug 11 16:43:25.921481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 566/1403] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:26.937872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:26.941688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:26.948150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:26.948879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:26.949315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:26.950191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:26.950807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:26.951409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:26.982739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-514ce365-7989-419c-8877-dd97a12c6a1c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051563 Aug 11 16:43:26.983401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 838/1404] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:28.001974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:28.004067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:28.010759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:28.011238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:28.011667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:28.012395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:28.012841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:28.013261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:28.030522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:43:28.045265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ecd0119-4a51-412e-a741-d0fcf7f870bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Aug 11 16:43:28.045827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 567/1405] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:29.057402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:29.059546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:29.066583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:29.067059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:29.067490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:29.068206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:29.068658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:29.069074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:29.097975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3516cb88-de56-4772-83e2-3911654ae2a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 11 16:43:29.098531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 839/1406] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:30.110123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:30.112337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:30.118831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:30.119300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:30.119730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:30.120429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:30.120874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:30.121288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:30.152421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ba614929-24e0-4caf-89e6-8aab4c7ac52a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046601 Aug 11 16:43:30.152976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 568/1407] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:31.164038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:31.166231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:31.173777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:31.174418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:31.174861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:31.175564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:31.176019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:31.176468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:31.206280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bffaf8fd-eff0-4594-a2e0-28f12cbb9d38 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 11 16:43:31.206843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 840/1408] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:32.218968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:32.221803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:32.227942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:32.228443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:32.228871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:32.229545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:32.229988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:32.230404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:32.259199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0dcffe2a-78be-440e-840f-d01b5efebf61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 11 16:43:32.259740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 569/1409] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:33.271890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:33.274049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:33.280435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:33.280907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:33.281338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:33.282364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:33.282946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:33.283368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:33.312391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8e93856e-f81d-4ae1-b067-0ed24cecb181 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 11 16:43:33.313558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 841/1410] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:34.325560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:34.327839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:34.334954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:34.335440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:34.335876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:34.336603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:34.337056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:34.337482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:34.365789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d101d076-972f-4bbe-bf60-11e4b64ccbd0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Aug 11 16:43:34.366344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 570/1411] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:35.378686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:35.380783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:35.387265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:35.387742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:35.388203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:35.388891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:35.389343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:35.389764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:35.419658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bb633ebf-9064-4a3b-bade-25e384826706 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Aug 11 16:43:35.420225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 842/1412] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:36.432258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:36.434449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:36.441261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:36.441732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:36.442158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:36.442837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:36.443279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:36.443694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:36.473213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4dbe5b0b-9703-4ad9-b307-6c95f7fe62c0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Aug 11 16:43:36.473755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 571/1413] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:37.486108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:37.488197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:37.494726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:37.495206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:37.495643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:37.496359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:37.496812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:37.497232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:37.501975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:43:37.529839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-014a830e-e9e3-4ed3-82e8-8301269136fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048077 Aug 11 16:43:37.530833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 843/1414] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:38.543349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:38.545426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:38.551839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:38.552337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:38.552767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:38.553444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:38.553889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:38.554303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:38.583028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7225ede6-52db-4184-90af-325884338690 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Aug 11 16:43:38.583570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 572/1415] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:39.596293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:39.598447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:39.600749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=35 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:43:39.606140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:39.606615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:39.607040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:39.607718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:39.608189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:39.608609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:39.637768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8239fb0b-3463-46cc-a355-dfdab1b7ef73 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Aug 11 16:43:39.638320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 844/1416] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:40.650193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:40.652397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:40.659381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:40.659857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:40.660334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:40.661005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:40.661452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:40.661870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:40.690891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d2be23da-72db-4ba5-bfd5-25484d109226 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Aug 11 16:43:40.691443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 573/1417] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:41.703024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:41.705778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:41.712154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:41.712636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:41.713070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:41.713756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:41.714204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:41.714626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:41.743286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-48b2b58c-573f-4447-8a7d-12be0221bbec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 11 16:43:41.743825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 845/1418] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:42.755691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:42.757870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:42.764588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:42.765066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:42.765498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:42.767097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:42.767677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:42.768120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:42.796744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1bdc8519-a49c-44ae-9ff8-277330abe92a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Aug 11 16:43:42.797249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 574/1419] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:43.810706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:43.813661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:43.821507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:43.822114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:43.822557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:43.823452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:43.823951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:43.824480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:43.858225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c87465ef-8f1f-4138-a93e-af23ce4da0c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052313 Aug 11 16:43:43.858779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 846/1420] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:44.870739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:44.872920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:44.880072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:44.880581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:44.881020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:44.881713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:44.882172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:44.882599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:44.911596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-baf10fc5-0e30-4e50-8bbb-cb90a8157e00 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Aug 11 16:43:44.912173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 575/1421] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:45.924775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:45.926959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:45.933369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:45.933850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:45.934282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:45.934970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:45.935424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:45.935848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:45.966627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d48ce8f6-9404-42a2-951b-f7e23331a572 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Aug 11 16:43:45.967170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 847/1422] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:46.978944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:46.981152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:46.988329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:46.988812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:46.989252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:46.989942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:46.990398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:46.990822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:47.020775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e1e5f7f4-41c2-44d8-b119-7f4b8a497205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Aug 11 16:43:47.021329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 576/1423] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:48.033297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:48.035427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:48.042108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:48.042590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:48.043020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:48.043709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:48.044184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:48.044650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:48.074545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9af0df93-2b5d-42c9-a889-89b085f2009f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Aug 11 16:43:48.075097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 848/1424] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:48.198275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:43:48.198490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:43:49.087595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:49.089774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:49.092525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=50 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:43:49.098342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:49.098819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:49.099253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:49.099937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:49.100413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:49.100836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:49.129233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e8b76d83-e20c-4b2f-8ba4-7ae696e7debc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Aug 11 16:43:49.129781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 577/1425] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:50.141734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:50.144060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:50.150659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:50.151147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:50.151586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:50.152329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:50.152789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:50.153223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:50.183791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a26f47e7-44d3-499e-a53e-096bb1fd70a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Aug 11 16:43:50.184380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 849/1426] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:51.196538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:51.198743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:51.205251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:51.205735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:51.206176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:51.206868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:51.207322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:51.207749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:51.236715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2a9a7e77-c428-4ebf-841d-f47bd31d4b50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Aug 11 16:43:51.237258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 578/1427] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:52.249058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:52.251878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:52.258386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:52.258867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:52.259304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:52.259999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:52.260475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:52.260901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:52.289205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec0c4779-2903-4bc8-b19d-a644bba00da1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Aug 11 16:43:52.289747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 850/1428] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:53.302304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:53.304518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:53.311048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:53.311474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:53.312184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:53.313035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:53.313490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:53.313917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:53.343463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c43b825e-8a91-42a6-bb8d-08d5d4e0ded2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 11 16:43:53.344592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 579/1429] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:54.356257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:54.358501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:54.365484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:54.365996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:54.366438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:54.367132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:54.367587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:54.368012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:54.397241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d9b085c-48dc-4ccd-a9ae-7a2cc1cdb144 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Aug 11 16:43:54.397785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 851/1430] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:55.410182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:55.412307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:55.418700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:55.419176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:55.419605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:55.420314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:55.420759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:55.421178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:55.450853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0f891fbf-0ba0-4b89-8a8a-5ff1c2aa6a22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Aug 11 16:43:55.451398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 580/1431] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:56.463666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:56.465799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:56.473065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:56.473547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:56.473980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:56.474670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:56.475124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:56.475550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:56.504464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a8d501f-cf5a-4eb1-b131-de17979b56e5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Aug 11 16:43:56.505015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 852/1432] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:57.515932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:57.518125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:57.524533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:57.525009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:57.525441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:57.526119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:57.526564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:57.526980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:57.556862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d30aa198-ff0e-4a57-8b32-deeb3b7a3244 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Aug 11 16:43:57.557419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 581/1433] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:58.569756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:58.571905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:58.578892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:58.579692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:58.580165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:58.580864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:58.581317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:58.581742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:58.611594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2188745f-362b-46ca-82db-8620c32dac61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Aug 11 16:43:58.612162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 853/1434] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:43:59.623716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:43:59.626098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:43:59.632574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:59.633050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:59.633479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:59.634159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:43:59.634600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:43:59.635017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:43:59.665928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fa429570-1b4d-4d39-8245-c17beb37ed03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 11 16:43:59.666488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 582/1435] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:43:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:00.678985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:00.681154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:00.687974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:00.688597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:00.689034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:00.689729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:00.690182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:00.690610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:00.719823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b05803f-179e-472d-bb04-ffc4feca4586 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Aug 11 16:44:00.720400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 854/1436] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:01.731543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:01.733689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:01.740652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:01.741127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:01.741556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:01.742240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:01.742681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:01.743095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:01.745438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=93 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:01.772451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-36fe2d7b-f150-4e49-839a-ac157e9143b8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Aug 11 16:44:01.772998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 583/1437] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:02.784839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:02.786981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:02.793368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:02.793830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:02.794289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:02.794967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:02.795413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:02.795832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:02.825288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9cfbaddf-651b-4ed1-b92d-26560a9e12ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Aug 11 16:44:02.825850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 855/1438] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:03.837509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:03.839654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:03.846666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:03.847148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:03.847587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:03.848324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:03.848779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:03.849206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:03.881385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2267ff3c-8cf6-43ad-8a09-5c310440673e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047859 Aug 11 16:44:03.881942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 584/1439] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:04.894423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:04.896586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:04.903103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:04.903728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:04.904243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:04.904930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:04.905379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:04.905799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:04.934792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c43a45f5-cea0-46c0-94e6-3c9d2e72b059 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Aug 11 16:44:04.935328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 856/1440] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:05.947508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:05.949598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:05.956057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:05.956562 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:05.956993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:05.957675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:05.958117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:05.958533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:05.987893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-044f508c-6577-4290-a3e6-ab544c9c3d33 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044579 Aug 11 16:44:05.988461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 585/1441] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:07.000760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:07.002864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:07.009316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:07.009799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:07.010234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:07.010921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:07.011374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:07.011809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:07.040649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-332e0391-785f-4cd0-9541-214589f8aa61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Aug 11 16:44:07.041202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 857/1442] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:08.052731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:08.054880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:08.061364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:08.062104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:08.063043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:08.063901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:08.064423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:08.064854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:08.093827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8ba4a32c-c2e2-4645-9c50-b18c7c61e231 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Aug 11 16:44:08.094373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 586/1443] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:09.105980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:09.108212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:09.115450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:09.115927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:09.116411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:09.117097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:09.117544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:09.117965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:09.121498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=89 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:09.146461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-706e7bdb-08b0-46b7-ab31-c625e3388c49 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Aug 11 16:44:09.147006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 858/1444] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:10.159445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:10.161699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:10.172751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:10.173238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:10.173676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:10.174372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:10.174822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:10.175245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:10.204806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fb643d60-d91c-4d09-985d-5db95e49fd88 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050390 Aug 11 16:44:10.205355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 587/1445] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:11.217058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:11.219868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:11.222225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=30 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:11.227690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:11.228208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:11.228654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:11.229347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:11.229793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:11.230216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:11.259737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c334c0f1-9a11-4481-ab35-99e27f808573 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Aug 11 16:44:11.260315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 859/1446] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:12.271756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:12.273922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:12.280412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:12.281030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:12.281465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:12.282155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:12.282603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:12.283027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:12.314150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c8a2579e-6e59-4991-aae1-c1f6fae4fd4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 11 16:44:12.314643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 588/1447] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:13.326640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:13.329422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:13.335747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:13.336260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:13.336701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:13.337395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:13.337844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:13.338311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:13.368991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-477dd7fe-6d56-4cc5-80a1-3e17945dc802 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Aug 11 16:44:13.369540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 860/1448] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:14.381548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:14.383628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:14.390100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:14.390581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:14.391020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:14.391711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:14.392195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:14.392624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:14.422081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-771b0c77-567f-4c22-a6f0-3bef295e781c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Aug 11 16:44:14.422628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 589/1449] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:15.433282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:15.435414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:15.442140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:15.442617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:15.443047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:15.443729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:15.444197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:15.444614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:15.473697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7fcc60e1-0420-47a5-b918-445cac2774f5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Aug 11 16:44:15.474235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 861/1450] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:44:16.486021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:16.488077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:16.494539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:16.495011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:16.495441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:16.496135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:16.496584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:16.497018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:16.526694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9232409c-dc45-4668-8c33-7b99105b95b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Aug 11 16:44:16.527243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 590/1451] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:17.539971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:17.542252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:17.549022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:17.549539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:17.549972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:17.550697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:17.551121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:17.551547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:17.580674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5f86c3e-fb66-48b5-a97d-7cded2c9d9fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Aug 11 16:44:17.581224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 862/1452] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:18.592879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:18.595687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:18.602172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:18.602650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:18.603088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:18.603773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:18.604267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:18.604692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:18.633541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-59a884d5-cfc0-482c-8919-7e0418e67bad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 11 16:44:18.634092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 591/1453] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:19.645905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:19.648040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:19.654757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:19.655252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:19.656619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:19.656982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:19.657440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:19.657873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:19.687607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3d2567bf-b496-48ec-8ef5-7ee483ea9d58 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Aug 11 16:44:19.688179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 863/1454] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:20.699075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:20.701201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:20.703605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=30 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:20.709201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:20.709687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:20.710123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:20.710813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:20.711294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:20.711715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:20.740462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-97ef74e1-712d-47ce-a0b0-21e669850973 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 11 16:44:20.741110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 592/1455] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:21.753442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:21.755518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:21.762046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:21.762525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:21.762960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:21.763646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:21.764129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:21.764549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:21.793524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-451cfe9b-2b8c-421b-93d8-974b9e9fd29c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 11 16:44:21.794074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 864/1456] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:22.805835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:22.808019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:22.818629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:22.819110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:22.819546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:22.820282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:22.820734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:22.821155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:22.850848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b3fc873f-a8e0-4d88-8298-ab34b7a885a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Aug 11 16:44:22.851395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 593/1457] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:23.863141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:23.865367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:23.872087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:23.872616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:23.873054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:23.873755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:23.875204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:23.875635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:23.904860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc79445b-9665-46c9-9d7f-736f0b23b21a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 Aug 11 16:44:23.905493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 865/1458] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:24.916445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:24.918613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:24.925603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:24.926084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:24.926514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:24.927198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:24.927641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:24.928055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:24.958085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-335cd695-1a18-473e-ad7d-84983cbe80f0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 11 16:44:24.958657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 594/1459] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:25.970973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:25.973054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:25.979336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:25.979808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:25.980284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:25.980960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:25.981403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:25.981819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:26.011038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2d79b3d1-f217-47e4-aa48-eebc951a87e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Aug 11 16:44:26.011577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 866/1460] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:27.023711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:27.025933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:27.032788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:27.033263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:27.033691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:27.034381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:27.034825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:27.035241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:27.071022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d3223b39-e1e8-41a7-8258-410c70d99ddb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051420 Aug 11 16:44:27.072795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 595/1461] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:28.086978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:28.089305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:28.095538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:28.096029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:28.096508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:28.097206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:28.097659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:28.098085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:28.134962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-52f13365-9ec6-4992-9b70-1a236ae61a14 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051930 Aug 11 16:44:28.135543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 867/1462] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:29.147833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:29.150010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:29.156422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:29.156900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:29.157331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:29.158016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:29.158460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:29.158876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:29.189157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0fa7db0e-348d-46e4-84b2-74cad2fbfe03 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Aug 11 16:44:29.189794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 596/1463] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:30.203239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:30.205580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:30.212389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:30.212873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:30.213304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:30.213989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:30.214472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:30.214895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:30.245456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b21acccb-b00a-4bde-8ab4-0c3b0bece0ee tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047767 Aug 11 16:44:30.246250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 868/1464] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:31.258442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:31.260751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:31.268324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:31.268804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:31.269291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:31.269994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:31.270450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:31.270856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:31.301460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-191a6a73-cd0c-4dc9-a9f3-20e8daeed917 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047923 Aug 11 16:44:31.302021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 597/1465] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:32.314841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:32.317028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:32.323454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:32.323931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:32.324423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:32.325109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:32.325553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:32.326000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:32.356177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ebcd234-9948-4fb5-aef7-923231c8a2e8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Aug 11 16:44:32.356661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 869/1466] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:33.368314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:33.370452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:33.376994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:33.377485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:33.377928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:33.378628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:33.379083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:33.379507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:33.382017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=90 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:33.411201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-316f2fe7-d288-40c6-a866-278401cbd052 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046869 Aug 11 16:44:33.411676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 598/1467] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:34.424062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:34.426197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:34.432724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:34.433211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:34.433650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:34.434344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:34.434796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:34.435224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:34.463758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c712e429-11d8-474e-9cc8-7595c597cbe2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 11 16:44:34.464427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 870/1468] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:35.476871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:35.478933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:35.485611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:35.486092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:35.486531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:35.487222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:35.487672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:35.488119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:35.517247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3524a1eb-1bf6-4c57-93ea-46a0c676f6a2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Aug 11 16:44:35.517797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 599/1469] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:36.529531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:36.532275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:36.538521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:36.539003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:36.539438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:36.540177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:36.540630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:36.541053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:36.570731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-195e9ada-1846-453f-b2dc-1cb34afff8a0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 11 16:44:36.571265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 871/1470] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:37.583032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:37.585531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:37.591920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:37.592959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:37.593391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:37.594067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:37.594511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:37.595194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:37.624852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fc3ff1f4-c50c-4b30-94ee-a133fa301a26 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Aug 11 16:44:37.625399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 600/1471] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:38.637022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:38.639830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:38.646251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:38.646725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:38.647155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:38.647834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:38.648317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:38.648735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:38.678111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d5fbff4f-feb7-46e9-8fd6-8ced254245df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Aug 11 16:44:38.678652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 872/1472] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:39.691745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:39.693923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:39.700355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:39.700834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:39.701268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:39.702827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:39.703376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:39.703803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:39.732113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d8a9ab6d-be80-4797-825b-3579d97ffaeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Aug 11 16:44:39.732664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 601/1473] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:44:40.744317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:40.746469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:40.753695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:40.754180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:40.754620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:40.755318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:40.755777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:40.756231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:40.759929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=90 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:40.786615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9580471e-fc5d-497d-9a1b-325a8950050f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Aug 11 16:44:40.787171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 873/1474] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:41.799824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:41.801953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:41.808402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:41.808883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:41.809319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:41.810009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:41.810461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:41.811564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:41.840656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3fb7bea0-ac83-4824-8506-c5a9d04f9f8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Aug 11 16:44:41.841207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 602/1475] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:42.853817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:42.855870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:42.858284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=30 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:42.863743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:42.864247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:42.864681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:42.865360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:42.865805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:42.866222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:42.896243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-172e8ee8-d1c1-4aa5-8739-028b66c4aabf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Aug 11 16:44:42.897013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 874/1476] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:43.908712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:43.910892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:43.917284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:43.917762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:43.918196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:43.918880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:43.919328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:43.919751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:43.949539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6227ba59-2665-45bf-a4db-35e071772b37 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 11 16:44:43.950090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 603/1477] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:44.961989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:44.964163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:44.970951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:44.971443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:44.971879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:44.972608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:44.973063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:44.973492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:45.002287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf4dfa5d-7f8d-416e-b4e3-4dc0ceae0ce5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 11 16:44:45.002839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 875/1478] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:46.014827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:46.016993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:46.023339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:46.023812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:46.024285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:46.024965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:46.025409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:46.025825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:46.055149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-27f3e745-b2ab-4fd0-8498-c9f66d29c742 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Aug 11 16:44:46.055724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 604/1479] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:47.067697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:47.069845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:47.076331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:47.076811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:47.077238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:47.077920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:47.078363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:47.078805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:47.108241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-beec72be-8fdf-43bd-8c4c-0fd5ecb533e1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 11 16:44:47.108905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 876/1480] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:48.120549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:48.122750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:48.129392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:48.129867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:48.130296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:48.131004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:48.131450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:48.131867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:48.160908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-98682e6e-db69-44c0-bcb4-fb85ac05df57 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Aug 11 16:44:48.161443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 605/1481] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:49.173374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:49.175681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:49.182070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:49.182552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:49.182983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:49.183670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:49.184137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:49.184563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:49.214214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac73eec0-016d-41cc-a2ee-9b31b256c1b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044823 Aug 11 16:44:49.214757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 877/1482] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:50.227012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:50.229183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:50.236224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:50.236704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:50.237137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:50.237824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:50.238273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:50.238695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:50.267506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a9c7461f-e529-4da5-b5d9-3858e711e418 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Aug 11 16:44:50.268065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 606/1483] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:51.278903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:51.281882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:51.288436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:51.288921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:51.289355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:51.290048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:51.290503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:51.290926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:51.319396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-495ba8bf-8d4e-44bb-9898-723b309a356d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Aug 11 16:44:51.319881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 878/1484] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:52.332359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:52.334426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:52.336786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=30 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:44:52.341972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:52.342451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:52.342888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:52.343608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:52.344056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:52.344518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:52.373631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-42e93e5e-56ee-41c1-be93-25fe8e4eb9d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Aug 11 16:44:52.374685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 607/1485] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:53.385911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:53.388148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:53.395536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:53.396020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:53.396485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:53.397181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:53.397633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:53.398059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:53.427332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bfa2f415-4069-4a37-bf9b-6081a557cce2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Aug 11 16:44:53.427881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 879/1486] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:54.333283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:44:54.333476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:44:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:44:54.440052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:54.442187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:54.448522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:54.448993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:54.449421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:54.450118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:54.450559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:54.450973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:54.478856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e8a31892-9853-4f10-9581-4d876af15f41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Aug 11 16:44:54.479391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 608/1487] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:55.491062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:55.493182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:55.500231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:55.500747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:55.501187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:55.501879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:55.502332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:55.502784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:55.532111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-45622e25-32e9-4954-b6d9-e6b2b403562f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 11 16:44:55.532683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 880/1488] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:56.544512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:56.546746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:56.553165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:56.553652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:56.554094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:56.554815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:56.555270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:56.555696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:56.585290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fe74249f-9539-4a4d-8a13-191683f0335d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Aug 11 16:44:56.585839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 609/1489] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:57.597912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:57.600062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:57.606511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:57.606993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:57.607430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:57.608157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:57.608805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:57.609259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:57.638772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9e737fa-3858-4c2a-a770-9467daf90931 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Aug 11 16:44:57.639313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 881/1490] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:58.651811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:58.653990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:58.660885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:58.661363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:58.661793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:58.662470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:58.662917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:58.663338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:58.692456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fad5f553-1c11-49f0-8884-4f9019b05156 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Aug 11 16:44:58.693000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 610/1491] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:44:59.705155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:44:59.707314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:44:59.713422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:59.713901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:59.714331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:59.715016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:44:59.715466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:44:59.715889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:44:59.744599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a724c773-a8e6-421e-867e-9a15437a3ac6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 11 16:44:59.745124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 882/1492] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:44:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:00.756916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:00.759034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:00.766715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:00.767173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:00.767608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:00.768417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:00.768910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:00.769367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:00.798574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-92a77c67-e045-42c6-9245-52c1a8c6b2d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Aug 11 16:45:00.799131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 611/1493] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:01.810814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:01.813872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:01.820461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:01.820944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:01.821381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:01.822063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:01.822516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:01.822936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:01.852170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67e77fbe-b998-48d6-871c-474692497d35 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Aug 11 16:45:01.852721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 883/1494] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:02.866668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:02.868857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:02.875962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:02.876469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:02.876924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:02.877662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:02.878108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:02.878526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:02.908498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-31b07e47-37b8-41da-9e4b-0594eef8be08 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Aug 11 16:45:02.909049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 612/1495] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:03.921720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:03.924183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:03.930570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:03.931055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:03.931495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:03.932210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:03.932667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:03.933092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:03.963327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e79f69ec-071a-44b6-a124-b9769e6a2ca1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046464 Aug 11 16:45:03.964118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 884/1496] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:04.975783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:04.977947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:04.984608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:04.985092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:04.985528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:04.986216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:04.986808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:04.987234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:04.989599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=90 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:05.017115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5f4ffcd5-a88e-435c-8bfe-2706d4cbfce8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Aug 11 16:45:05.017671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 613/1497] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:06.029612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:06.032215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:06.038569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:06.039048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:06.039482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:06.040200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:06.040650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:06.041067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:06.070823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-02d4b2a4-9be2-4604-8406-076438354f21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 11 16:45:06.071366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 885/1498] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:07.083661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:07.085878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:07.092258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:07.092755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:07.093179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:07.094603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:07.095059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:07.095486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:07.123750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5f553cf5-7e49-45c9-a806-12259e1b692c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Aug 11 16:45:07.124324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 614/1499] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:08.136172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:08.138273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:08.144727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:08.145204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:08.145634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:08.146312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:08.146755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:08.147173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:08.176800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5097bdfb-3d3b-45d2-b0f2-48ce2a6df14e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 11 16:45:08.177335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 886/1500] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:09.190168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:09.192353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:09.199021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:09.199507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:09.199940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:09.200666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:09.201116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:09.201537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:09.230744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bbf9427e-2d0f-4ca0-b637-1c0dff9967c4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Aug 11 16:45:09.231293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 615/1501] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:10.243588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:10.245741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:10.253142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:10.253624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:10.254461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:10.255159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:10.255607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:10.256029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:10.285450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-65c01ea4-8cd2-40d3-bf8a-f13d8f562ef2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045773 Aug 11 16:45:10.285993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 887/1502] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:11.297470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:11.300365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:11.306791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:11.307206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:11.307636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:11.308345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:11.308792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:11.309209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:11.337626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e30fa7a9-d528-4f03-85aa-992fa16abac2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Aug 11 16:45:11.338174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 616/1503] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:12.350682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:12.352894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:12.359413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:12.359899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:12.361088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:12.361987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:12.362457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:12.362883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:12.365358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=90 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:12.393036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbda5061-7987-4f5f-bca7-87c0f1289150 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046397 Aug 11 16:45:12.393586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 888/1504] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:13.405468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:13.408278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:13.414740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:13.415225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:13.415660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:13.416386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:13.416843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:13.417272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:13.446337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-36becc8f-1d37-4802-96ab-4ec2404ad897 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Aug 11 16:45:13.446887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 617/1505] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:14.459482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:14.461856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:14.464209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=30 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:14.469637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:14.470123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:14.470551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:14.471240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:14.471685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:14.472125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:14.499997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8f0d3bc-a75d-4fdf-86cf-fd554b1ef402 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Aug 11 16:45:14.501081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 889/1506] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:15.512890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:15.515064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:15.522509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:15.522989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:15.523421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:15.524126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:15.524581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:15.525003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:15.554716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-58146f53-98b1-4b14-9fe4-07d39c8035ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Aug 11 16:45:15.555493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 618/1507] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:16.567673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:16.569862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:16.576203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:16.576684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:16.577113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:16.577793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:16.578239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:16.578720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:16.606820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95ea22c0-4573-45d6-88fa-3eae0fbafcff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Aug 11 16:45:16.607354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 890/1508] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:17.619476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:17.621713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:17.628694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:17.629178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:17.629616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:17.630306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:17.630762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:17.631185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:17.660581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41aecd5d-c220-498c-8dd0-cf942a2f97dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Aug 11 16:45:17.661139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 619/1509] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:18.673469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:18.675594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:18.681971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:18.682440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:18.682865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:18.683537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:18.683989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:18.684434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:18.713792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bece9a46-68b1-4038-b10f-8512eccfb26a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 11 16:45:18.714341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 891/1510] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:19.523199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:19.523786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:19.530959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.531500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.532039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.532856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.533326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.533748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.559855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:45:19.640038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1e597cf6-cf03-42f5-a2ae-6ac60135abbd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 204 len: 0 microversion: 2.20 time: 0.120988 Aug 11 16:45:19.640890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 620/1511] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Aug 11 16:45:19 2022] DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 16:45:19.653930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:19.654534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:19.661194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.661675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.662107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.662792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.663244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.663667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.727515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:19.729771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:19.736999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.737489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.737924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.738630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:19.739081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:19.739506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:19.771732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4d98151-6af7-429d-8a51-92bbfa71ad59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048532 Aug 11 16:45:19.772361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 621/1512] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:45:19.795773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:19.805226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:19.806792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:19.807946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b7b6059-f74b-43b1-b881-d50b7e34975e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1802 microversion: 2.20 time: 0.162393 Aug 11 16:45:19.808550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 892/1513] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:20.783299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:20.785593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:20.791980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:20.792486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:20.792926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:20.793617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:20.794063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:20.794487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:20.824517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3db6dc1b-022d-4dee-8b7e-c9631af897d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 11 16:45:20.825102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 622/1514] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:45:20.832052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:20.833249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:20.839937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:20.840568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:20.841006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:20.841699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:20.842149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:20.842572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:20.910134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:20.918650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:20.920190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:20.921371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ff681b5-5e7a-469e-8324-9efe6d757249 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1734 microversion: 2.20 time: 0.094230 Aug 11 16:45:20.921937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 893/1515] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1734 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:21.334143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228fe15a-7159-4dbe-89fa-2340fc3c0558", "name": "network-vif-deleted", "tag": "59174fa9-dbeb-4a22-9c67-48d969030ba6"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:45:21.361302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:21.362173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:21.365215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:21.379549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] Creating event network-vif-deleted:59174fa9-dbeb-4a22-9c67-48d969030ba6 for instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 on hv-cinder-85220 Aug 11 16:45:21.385960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-2bbe0b41-c43b-4d84-8183-30665e3e24b5 req-4c753614-771e-409f-b140-953425860b51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255041 Aug 11 16:45:21.391177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 623/1516] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:21.837806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:21.840069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:21.846964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:21.847458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:21.847889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:21.848618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:21.849068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:21.849486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:21.882276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e24732f-bd45-4f7b-a047-08ddcc6099dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Aug 11 16:45:21.886822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 894/1517] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:21.946480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:21.947182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:21.955627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:21.956350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:21.956860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:21.957871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:21.958393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:21.958889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:22.186415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:22.198062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:22.199937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:22.201416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-87ad967f-84d7-4cca-b4a3-f341982b78e7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.259318 Aug 11 16:45:22.201973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 624/1518] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:22.895161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:22.897324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:22.903833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:22.904344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:22.904929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:22.905601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:22.906044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:22.906461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:22.935688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d66e0110-284a-42d6-afeb-79b15bebe20e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Aug 11 16:45:22.936275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 895/1519] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:23.027966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:45:23.028531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:45:23.226022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:23.226626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:23.228945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:23.234338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:23.234946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:23.235388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:23.236299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:23.236749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:23.237169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:23.304514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:23.313336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:23.314998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:23.316181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c406d29b-e8cb-46bd-924d-29da5e1b0d11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.094269 Aug 11 16:45:23.320786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 625/1520] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:23.948975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:23.951147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:23.958725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:23.959292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:23.959820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:23.960794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:23.961247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:23.961672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:23.992390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-945d9c34-1ac2-473b-9daf-28162d0120ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047559 Aug 11 16:45:23.992942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 896/1521] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:24.339682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:24.340829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:24.348997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:24.349478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:24.349911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:24.350606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:24.351094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:24.351603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:24.419390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:24.428719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:24.430312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:24.431849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b6a14a20-7147-4751-8327-1243d7db9e88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.096953 Aug 11 16:45:24.432840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 626/1522] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:25.005801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:25.008735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:25.015333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:25.016931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:25.017566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:25.018485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:25.019086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:25.019763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:25.051888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d36f9ee4-27fc-41c8-949e-1958e5e4942e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050172 Aug 11 16:45:25.053115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 897/1523] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:25.455320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:25.455931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:25.462587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:25.463074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:25.463513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:25.464236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:25.464690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:25.465118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:25.526486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:25.535870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:25.537408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:25.538557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-677bc106-de42-4931-ba1c-0bea8c7c2869 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087683 Aug 11 16:45:25.539110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 627/1524] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:26.065947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:26.068088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:26.074618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:26.075099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:26.075538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:26.076261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:26.076715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:26.077138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:26.106702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5c22169-82bb-4f65-b570-1bc3757e80fa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Aug 11 16:45:26.107245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 898/1525] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:26.561074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:26.561665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:26.568645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:26.569124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:26.569557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:26.570248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:26.570699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:26.571119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:26.663974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:26.666188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:26.674239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:26.675733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:26.676923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d5b6fa5f-525b-4b09-b183-e093e55d6beb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.119934 Aug 11 16:45:26.677487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 628/1526] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:27.119110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:27.121311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:27.128560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:27.129045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:27.129484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:27.130175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:27.130618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:27.131037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:27.161635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f95bceb2-1c1c-4585-909a-63f9f3338ea1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Aug 11 16:45:27.162873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 899/1527] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:27.701475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:27.702139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:27.710650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:27.711112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:27.711564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:27.712288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:27.712741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:27.713166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:27.778024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:27.787449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:27.788993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:27.790131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-76e6d24f-85be-481c-a2ec-e65b15804df3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092662 Aug 11 16:45:27.790679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 629/1528] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:28.173531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:28.175714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:28.181724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:28.182201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:28.182652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:28.183316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:28.183762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:28.184207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:28.212893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-261e414f-fdf3-49e9-a388-ee27efef5212 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044001 Aug 11 16:45:28.213431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 900/1529] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:28.812442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:28.813564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:28.820517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:28.820993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:28.821426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:28.822117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:28.822566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:28.822992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:28.884355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:28.893513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:28.895020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:28.896187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-784f37dd-f2aa-49cb-93d4-ac65b2e01f1d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087928 Aug 11 16:45:28.896744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 630/1530] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:29.225829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:29.227908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:29.234373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:29.234864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:29.235304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:29.235995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:29.236484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:29.236911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:29.265234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4dedf9ef-1f95-4e97-8d65-32f04587245a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Aug 11 16:45:29.266301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 901/1531] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:29.918706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:29.919229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:29.926343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:29.926815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:29.927250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:29.927931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:29.928399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:29.928815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:29.989088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:29.997258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:29.998765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:29.999887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ca0724f5-cf38-4ab3-ada9-bbb20bb62eda tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085170 Aug 11 16:45:30.001216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 631/1532] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:30.278216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:30.280369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:30.287582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:30.288065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:30.288531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:30.289223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:30.289675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:30.290101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:30.319821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d5c05137-447c-48cf-a56a-bfd78e6c22b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Aug 11 16:45:30.320399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 902/1533] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:31.022912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:31.023522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:31.029933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:31.030412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:31.030850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:31.032350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:31.032919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:31.033350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:31.096680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:31.105013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:31.106512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:31.107648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-10f1ff20-baac-43d6-a4fb-b4aea0ad1d45 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088740 Aug 11 16:45:31.108242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 632/1534] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:31.333179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:31.335350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:31.341771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:31.342253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:31.342692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:31.343380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:31.345088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:31.345525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:31.374154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-04262595-d9a8-4115-9aee-5f9a55185c9d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Aug 11 16:45:31.374701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 903/1535] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:32.131158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:32.131760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:32.137970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:32.138395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:32.138827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:32.139511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:32.139961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:32.140411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:32.204987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:32.213305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:32.214796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:32.215928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-287e9e4a-4842-4c88-9b39-5f9054ebddc2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088752 Aug 11 16:45:32.216504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 633/1536] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:32.386265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:32.388508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:32.395549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:32.396028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:32.396516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:32.397201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:32.397646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:32.398068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:32.422279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:32.427231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-83408885-54b0-43a5-9dd0-88d05241e3a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Aug 11 16:45:32.427779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 904/1537] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:33.239904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:33.240473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:33.246889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:33.247366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:33.247800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:33.248517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:33.248966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:33.249388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:33.312043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:33.320553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:33.322104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:33.323216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cfed5304-d44b-4d16-9502-9133633c0e5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087289 Aug 11 16:45:33.323766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 634/1538] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:33.439485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:33.441684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:33.448554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:33.449035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:33.449463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:33.450153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:33.450642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:33.451067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:33.481007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-898eed64-2109-4acc-90e1-462626619f22 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Aug 11 16:45:33.482174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 905/1539] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:34.349504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:34.350147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:34.356622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:34.357106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:34.357541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:34.358228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:34.358677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:34.359104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:34.423572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:34.431925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:34.433472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:34.434610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6449d870-6f54-46b6-8ddc-7aa4cbac75ac tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090722 Aug 11 16:45:34.435160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 635/1540] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:34.494376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:34.496559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:34.503658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:34.504168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:34.504613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:34.505305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:34.505759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:34.506209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:34.535744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ccd0a32-f5ee-49cf-a32c-49e9e1531aeb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Aug 11 16:45:34.536327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 906/1541] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:35.458155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:35.458758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:35.465182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:35.465686 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:35.466118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:35.466793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:35.467233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:35.467647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:35.528056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:35.537185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:35.538679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:35.539812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b22a6fae-9f0c-4e6b-be7b-9370efa4f477 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085532 Aug 11 16:45:35.540391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 636/1542] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:35.548163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:35.550329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:35.556682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:35.557161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:35.557597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:35.558280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:35.558731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:35.559152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:35.588781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c858375b-706e-4461-a53b-346e14e1eb47 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Aug 11 16:45:35.589327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 907/1543] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:45:36.563411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:36.564010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:36.574134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:36.574610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:36.575042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:36.575732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:36.576203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:36.576623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:36.601266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:36.603421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:36.609907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:36.610380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:36.610812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:36.611500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:36.611949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:36.612392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:36.641546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:36.642093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82a80579-c0ac-4d27-b183-66482e322ed6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 11 16:45:36.642666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 908/1544] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:36.649883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:36.651394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:36.652574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8744a2bd-b953-4654-b16d-2c0ba08744ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.093382 Aug 11 16:45:36.653114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 637/1545] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:37.654315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:37.657052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:37.663470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:37.663948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:37.664411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:37.665095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:37.665541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:37.665958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:37.675486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:37.676123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:37.682569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:37.683055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:37.683492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:37.684204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:37.684657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:37.685081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:37.695910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9194f7a0-bab2-495f-83f0-4f4cbdff1ea2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 11 16:45:37.696494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 909/1546] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:37.748252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:37.756745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:37.758245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:37.759373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6227e1d4-df0b-41c8-a277-bbdb062ca684 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088644 Aug 11 16:45:37.759928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 638/1547] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:38.708814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:38.710940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:38.717399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:38.717873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:38.718306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:38.719946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:38.720494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:38.720970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:38.750125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d226454a-cfbe-45e5-8e1a-e69af80b0ba9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Aug 11 16:45:38.750694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 910/1548] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:38.782988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:38.783591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:38.790149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:38.790625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:38.791060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:38.791750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:38.792223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:38.792645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:38.854274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:38.862850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:38.864388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:38.865523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-691f9b11-c947-45fb-9551-4235933812e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087521 Aug 11 16:45:38.866080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 639/1549] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:39.761575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:39.764013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:39.772679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:39.773151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:39.773643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:39.774371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:39.774850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:39.775273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:39.804810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-52792df8-a7b7-4475-96f4-0c14b47f3cbf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Aug 11 16:45:39.805359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 911/1550] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:39.888559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:39.889096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:39.896257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:39.896739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:39.897177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:39.897864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:39.898312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:39.898768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:39.960510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:39.968998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:39.970514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:39.971662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f406e08-58d5-4aee-8abb-a5cd67cf2e20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087246 Aug 11 16:45:39.972250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 640/1551] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:40.817603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:40.819779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:40.826281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:40.826766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:40.827204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:40.827917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:40.828392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:40.828818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:40.857772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6dfd46c2-1189-4063-b746-b7fb2e01feb6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Aug 11 16:45:40.858326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 912/1552] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:40.993805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:40.994403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:41.000833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:41.001306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:41.001734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:41.002444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:41.002889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:41.003307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:41.067210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:41.075653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:41.077113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:41.078980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-28410e65-9d90-4dfd-8ed5-0b97edd3fab6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089064 Aug 11 16:45:41.079535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 641/1553] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:41.870807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:41.872893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:41.880367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:41.880848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:41.881276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:41.881957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:41.882401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:41.882815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:41.911218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a529978-43d5-4304-9250-44f2d71e73ca tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Aug 11 16:45:41.911757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 913/1554] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:42.101986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:42.102593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:42.109695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:42.110470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:42.110913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:42.111607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:42.112054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:42.112501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:42.175940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:42.184322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:42.185827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:42.187304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cbe4a23c-be26-4f02-8575-4e9d5857aea6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088883 Aug 11 16:45:42.187975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 642/1555] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:42.923296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:42.925432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:42.931837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:42.932363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:42.932792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:42.933479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:42.933924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:42.934342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:42.962559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6fdfc4bd-cd77-47d4-81f2-0a9fa7ec7793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Aug 11 16:45:42.963101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 914/1556] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:43.209210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:43.209743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:43.216264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:43.216740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:43.217167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:43.217842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:43.218909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:43.219390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:43.280379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:43.289285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:43.290779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:43.291912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-72879b57-74cd-4680-adfc-e2e2a74ade2e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086668 Aug 11 16:45:43.292490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 643/1557] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:43.975082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:43.977219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:43.983728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:43.984972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:43.985431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:43.986153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:43.986611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:43.987037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:44.017043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a453e64-29cf-452d-a1b1-f934938cf961 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Aug 11 16:45:44.017591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 915/1558] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:44.314020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:44.314626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:44.321024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:44.321500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:44.321928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:44.322633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:44.323148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:44.323571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:44.385066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:44.394323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:44.395834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:44.397024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0cc5a2c9-52eb-4c01-8eb2-415543e56e7a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087206 Aug 11 16:45:44.397579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 644/1559] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:45.029216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:45.031417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:45.033802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=54 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:45.039079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:45.039562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:45.040002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:45.040730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:45.041186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:45.041610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:45.072772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff4d3a11-c2c5-4a53-a317-98a517347c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Aug 11 16:45:45.073543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 916/1560] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:45.419176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:45.419789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:45.426906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:45.427387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:45.427832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:45.428560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:45.429016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:45.429440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:45.444275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:45.494034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:45.502533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:45.504050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:45.505218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9f7bdff6-5872-4189-9308-ef3bdcd8b1cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089995 Aug 11 16:45:45.505773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 645/1561] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:46.085234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:46.087371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:46.094400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:46.094882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:46.095309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:46.095991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:46.096461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:46.096879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:46.126562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d79add5-7991-456f-b274-b1a2a80886db tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Aug 11 16:45:46.127114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 917/1562] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:46.527399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:46.527955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:46.534966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:46.535446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:46.535882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:46.536598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:46.537044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:46.537468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:46.598307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:46.606592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:46.608112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:46.610238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7492c50f-ef7a-4813-9d58-bba50b7b0028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086602 Aug 11 16:45:46.610800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 646/1563] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:47.138930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:47.141928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:47.148347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:47.148831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:47.149265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:47.149959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:47.150410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:47.150836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:47.180124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a08232af-fd71-45be-b80f-b9fed8830b60 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Aug 11 16:45:47.180694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 918/1564] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:47.633412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:47.634017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:47.641287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:47.641761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:47.642190 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:47.642868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:47.643310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:47.643725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:47.704553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:47.712896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:47.714391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:47.715519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bf8356cd-8add-4e68-95db-1ddf5a659830 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086068 Aug 11 16:45:47.716070 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 647/1565] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:48.193822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:48.195990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:48.202383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:48.203501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:48.203962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:48.204672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:48.205118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:48.205533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:48.235137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2403f06-bcca-4e78-a41b-632f1caa72bc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Aug 11 16:45:48.235676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 919/1566] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:48.740869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:48.740869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:48.745935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:48.746410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:48.746843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:48.747534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:48.747986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:48.748444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:48.812331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:48.820725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:48.822214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:48.823346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d05094b1-eeef-4a33-bc9b-3b3e50a6d2c0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088525 Aug 11 16:45:48.823908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 648/1567] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:49.246835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:49.249075 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:49.256038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:49.256543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:49.256971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:49.257704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:49.258097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:49.258516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:49.288807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-93a2be13-2ced-406e-82de-762ee54bb0af tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046216 Aug 11 16:45:49.289350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 920/1568] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:49.846771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:49.847376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:49.853850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:49.854275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:49.854714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:49.855401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:49.855858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:49.856320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:49.919615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:49.928892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:49.930406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:49.931557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8e2d0db4-c79f-4f27-8fbb-df3b8297a89f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089378 Aug 11 16:45:49.932137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 649/1569] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:50.301811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:50.304021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:50.310383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:50.310859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:50.311291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:50.313020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:50.313498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:50.313925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:50.327319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:50.343506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-048e3f3e-7daa-4c57-97f0-932c1cbd6822 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 11 16:45:50.344091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 921/1570] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:50.954674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:50.955267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:50.961718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:50.962187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:50.962614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:50.963287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:50.963729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:50.964170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:51.024522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:51.033483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:51.034972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:51.036116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4d3c3407-aa12-4d75-8f0b-fa3066b1015f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086007 Aug 11 16:45:51.036849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 650/1571] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:51.355587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:51.357789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:51.364981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:51.365464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:51.365907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:51.366594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:51.367043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:51.367465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:51.395892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b6def80-6c3e-454f-a5ed-41260d38d78e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 11 16:45:51.396470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 922/1572] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:52.058534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:52.059148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:52.066322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:52.066798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:52.067229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:52.067914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:52.068395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:52.068819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:52.128956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:52.137260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:52.138761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:52.140552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02075c3b-1dc7-4753-b21d-f29f3407936c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085317 Aug 11 16:45:52.141115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 651/1573] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:52.408219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:52.410256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:52.416654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:52.417132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:52.417670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:52.418358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:52.418807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:52.419226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:52.448626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6299958a-a09d-4c00-9a0e-30e7f8cb907e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Aug 11 16:45:52.449169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 923/1574] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:53.162685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:53.163287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:53.169644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:53.170121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:53.170550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:53.171901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:53.172391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:53.172811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:53.232389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:53.241413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:53.242913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:53.244043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a2d84747-acdc-469b-a3d0-803884c82546 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085270 Aug 11 16:45:53.244614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 652/1575] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:53.460577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:53.462703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:53.469703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:53.470179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:53.470610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:53.471288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:53.471736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:53.472249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:53.500580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d51c9b01-de66-4632-8128-b73e19e9b6dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Aug 11 16:45:53.501119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 924/1576] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:45:54.266901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:54.267500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:54.269795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:45:54.275305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:54.275781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:54.276237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:54.276920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:54.277365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:54.277784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:54.342202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:54.351738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:54.353274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:54.354419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eda8ff38-adc3-44a1-9e4b-624b12862c98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091742 Aug 11 16:45:54.354979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 653/1577] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:54.512377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:54.514547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:54.521610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:54.522090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:54.522528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:54.523222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:54.523709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:54.524155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:54.553833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4f0f4439-5532-49f1-bbe0-61fb80a87fe1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Aug 11 16:45:54.554391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 925/1578] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:55.377944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:55.378546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:55.385047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:55.385535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:55.385978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:55.386668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:55.387120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:55.387548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:55.448394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:55.457499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:55.459013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:55.460181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-da736e06-54e6-454a-b320-49d8ec7ee946 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086881 Aug 11 16:45:55.460738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 654/1579] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:45:55.566560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:55.568695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:55.574988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:55.575460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:55.575890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:55.576597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:55.577047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:55.577517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:55.605769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-56b7d919-8762-49f2-bb2d-3f172f47c019 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 11 16:45:55.606319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 926/1580] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:56.482568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:56.483131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:56.489507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:56.489978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:56.490408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:56.491085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:56.491557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:56.491982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:56.553557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:56.562520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:56.564019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:56.565192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc0cd064-2279-4c3b-ac13-02380f44d6d8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086636 Aug 11 16:45:56.565747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 655/1581] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:56.618729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:56.620910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:56.628261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:56.628746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:56.629181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:56.629873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:56.630329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:56.630759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:56.664239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cbc56cbd-c756-40b7-8372-8337da22762b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049431 Aug 11 16:45:56.664794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 927/1582] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:57.587908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:57.588548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:57.595565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:57.596034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:57.596485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:57.597164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:57.597608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:57.598025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:57.659610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:57.668033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:57.669556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:57.671434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2a257815-a3e8-4334-b145-658bcdafda30 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086657 Aug 11 16:45:57.671434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 656/1583] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:57.676599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:57.678756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:57.685320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:57.685798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:57.686229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:57.687395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:57.687847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:57.688299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:57.716874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a4772bc8-80ad-49ce-87a5-cf75752a51a3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Aug 11 16:45:57.717413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 928/1584] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:58.693740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:58.694347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:58.700803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:58.701283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:58.701719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:58.702411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:58.702856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:58.703276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:58.729375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:58.731482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:58.738282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:58.738758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:58.739187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:58.739870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:58.740361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:58.740763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:58.766705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:58.770859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c838b5eb-82c4-403b-97a5-0169135604d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 11 16:45:58.771437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 929/1585] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:45:58.776947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:58.778464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:58.779620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-22dd2f45-6190-4a27-ad3d-94e5f610a221 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089875 Aug 11 16:45:58.780192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 657/1586] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:45:59.783160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:59.785320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:59.792598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:59.793087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:59.793525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:59.794214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:59.794671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:59.795091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:59.802655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:45:59.803251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:45:59.809626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:59.810097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:59.810526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:59.811205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:45:59.811649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:45:59.813587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:45:59.825677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-50dde25f-9792-4ae0-ae79-4691d6d6ebff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046744 Aug 11 16:45:59.826237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 930/1587] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:45:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:45:59.872758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:59.881759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:59.883263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:45:59.884440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff0d66eb-e01f-4956-9320-ef043066621a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085601 Aug 11 16:45:59.885007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 658/1588] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:45:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:00.838180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:00.840344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:00.847879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:00.848401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:00.848838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:00.849526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:00.849977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:00.850399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:00.880364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc6a7819-7d60-48ce-94a9-c2ff4473b491 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Aug 11 16:46:00.880919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 931/1589] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:00.906762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:00.907370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:00.913894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:00.914371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:00.914809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:00.915497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:00.915950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:00.916403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:00.978118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:00.986672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:00.988201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:00.989350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ca4006c6-4230-4f03-b21e-db17066ec7ba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086653 Aug 11 16:46:00.989909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 659/1590] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:01.893505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:01.895547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:01.902037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:01.902516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:01.902950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:01.903637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:01.904088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:01.904536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:01.934903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-498e6a3d-7ee8-4d63-bb3c-8d429030a2ff tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Aug 11 16:46:01.935448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 932/1591] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:02.012688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:02.013298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:02.019969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:02.020502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:02.020932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:02.021646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:02.022110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:02.022535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:02.083419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:02.091688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:02.093859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:02.095187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-10c60685-4eda-4f97-b48c-41d89bad8a4a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086760 Aug 11 16:46:02.095737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 660/1592] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:02.947004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:02.949198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:02.955616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:02.956090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:02.956552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:02.957236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:02.957689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:02.958113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:02.986894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d6fbee55-b25e-433d-83a8-073edd341a44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Aug 11 16:46:02.987429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 933/1593] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:03.116905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:03.117521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:03.124016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:03.124600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:03.125037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:03.125903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:03.126357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:03.126782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:03.191321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:03.199799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:03.201302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:03.202447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5e603bb1-03cf-42d7-8dc1-b5b52fcd64ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089471 Aug 11 16:46:03.203149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 661/1594] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:03.998954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:04.001767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:04.008191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:04.008673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:04.009107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:04.009797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:04.010249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:04.010675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:04.040275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dd9ed9cd-f854-4ccf-8c02-f2fea1d9ef6a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 11 16:46:04.040833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 934/1595] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:04.225203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:04.225728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:04.232232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:04.232720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:04.233158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:04.234433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:04.234892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:04.235320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:04.239793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:04.524238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:04.532874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:04.534392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:04.535548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-53771b6b-2b78-4a63-9910-c252ba62a091 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.314669 Aug 11 16:46:04.536139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 662/1596] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:05.053491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:05.055625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:05.064063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:05.064578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:05.065011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:05.065720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:05.066169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:05.066585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:05.096091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-802d0f28-19de-4804-83b5-20c0fc1c3e23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Aug 11 16:46:05.096669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 935/1597] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:05.558204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:05.558807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:05.565666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:05.566141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:05.566568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:05.567253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:05.567696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:05.568139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:05.628623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:05.637019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:05.638516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:05.639650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b91f2aab-ee9d-4fc5-a2e1-32532267c7da tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085381 Aug 11 16:46:05.640253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 663/1598] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:06.108235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:06.111062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:06.117486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:06.117963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:06.118391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:06.119099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:06.119545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:06.119963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:06.147906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6a8023b6-b5af-44de-8e68-a6ebb2217594 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 11 16:46:06.148471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 936/1599] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:06.663222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:06.663824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:06.670235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:06.670706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:06.671267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:06.672087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:06.672559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:06.672980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:06.735256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:06.743578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:06.745097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:06.746232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-714af692-56d7-4efa-a77d-30a3ab4180d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087239 Aug 11 16:46:06.746784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 664/1600] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:07.160818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:07.163069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:07.169450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:07.169926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:07.170353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:07.171030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:07.172126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:07.172559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:07.201304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-976c0e91-261e-4cbc-a270-8ef87e831992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 11 16:46:07.201840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 937/1601] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:07.769347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:07.769960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:07.776537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:07.777016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:07.777447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:07.778139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:07.778587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:07.779007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:07.840704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:07.849129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:07.850615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:07.851744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8127c4d3-e080-4f7f-ab03-922858d4fb00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087108 Aug 11 16:46:07.852335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 665/1602] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:08.214264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:08.216506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:08.223651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:08.224153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:08.224588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:08.225269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:08.225716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:08.226534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:08.229137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:08.257337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f27c30cc-db16-41f4-a129-5c900002ca36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047089 Aug 11 16:46:08.257878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 938/1603] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:08.873962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:08.875127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:08.881247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:08.881718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:08.882146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:08.882821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:08.883264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:08.883677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:08.946347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:08.955417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:08.956938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:08.958069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1faf4e37-380f-4f6b-95f9-a11ea9a649e3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088074 Aug 11 16:46:08.958615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 666/1604] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:09.270370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:09.272514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:09.278979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:09.279463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:09.279906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:09.280651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:09.281108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:09.281544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:09.311229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e672b345-e11f-4b3f-82d5-c58144d7a7da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 11 16:46:09.312667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 939/1605] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:09.982020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:09.982557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:09.990754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:09.991266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:09.991707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:09.992441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:09.992896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:09.993323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:10.058216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:10.067522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:10.069077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:10.070232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-30316ca4-4fa7-43dd-aa10-506f3ffd41ae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092320 Aug 11 16:46:10.070985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 667/1606] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:10.324589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:10.326729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:10.333479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:10.333967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:10.334406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:10.335101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:10.335557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:10.335981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:10.364900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7aa5824d-1ef4-4a44-bdd7-aa277f1f973d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 11 16:46:10.365452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 940/1607] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:11.092759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:11.093940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:11.100504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:11.100977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:11.101405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:11.102080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:11.102525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:11.102940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:11.165330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:11.173830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:11.175328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:11.176492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-170d9914-e179-43f5-924f-9e2bd583b5b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087638 Aug 11 16:46:11.177048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 668/1608] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:11.377585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:11.379694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:11.386076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:11.386553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:11.386985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:11.387663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:11.388134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:11.388547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:11.417994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8739fc41-806e-4f3e-b99b-71782df9f1d9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Aug 11 16:46:11.418549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 941/1609] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:12.198882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:12.199516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:12.207289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:12.207752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:12.208209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:12.208896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:12.209348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:12.209771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:12.270175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:12.278621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:12.280140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:12.281448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eb789da8-2bbd-4901-ae62-d03168ef582b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086529 Aug 11 16:46:12.282003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 669/1610] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:12.430592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:12.432708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:12.439795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:12.440314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:12.440747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:12.441428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:12.441873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:12.442292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:12.471144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d0afea2-78cb-4ca0-91ee-5ffc12ce6e3f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Aug 11 16:46:12.471678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 942/1611] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:13.303709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:13.304455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:13.310954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:13.311376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:13.312125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:13.312956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:13.313403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:13.313825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:13.377400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:13.385920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:13.387500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:13.388672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1e6a88cf-0818-4dd8-bf59-46bad722f758 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088890 Aug 11 16:46:13.389222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 670/1612] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:13.483117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:13.485311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:13.491683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:13.492202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:13.492644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:13.493339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:13.493792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:13.494221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:13.523801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-73a65f5f-fedc-4168-81a7-45b4bb306dec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Aug 11 16:46:13.524385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 943/1613] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:14.410879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:14.411483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:14.417895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:14.418374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:14.418803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:14.419488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:14.419934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:14.420374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:14.480929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:14.489225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:14.490719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:14.491853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-077f8b80-d7fc-4f45-8a7b-babdda493c40 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084909 Aug 11 16:46:14.492439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 671/1614] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:14.536276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:14.538431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:14.544743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:14.545218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:14.545651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:14.546574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:14.547026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:14.547441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:14.576600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-192398f8-db18-4d7b-9d73-8ebfa347606d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Aug 11 16:46:14.577192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 944/1615] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:15.516234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:15.516859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:15.523242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:15.523714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:15.524165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:15.524842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:15.525311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:15.525726 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:15.586273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:15.589483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:15.591726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:15.594686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=58 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:15.595475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:15.596880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:15.598021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f6d6613a-4b12-4f12-a92e-56fec3e475dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086438 Aug 11 16:46:15.598577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 672/1616] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:15.599912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:15.600429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:15.600872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:15.601611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:15.602069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:15.602503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:15.632198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0c6d5fb4-e5f2-429c-a8e2-4f5a945d08b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Aug 11 16:46:15.632753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 945/1617] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:16.620245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:16.620851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:16.628035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:16.628550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:16.628983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:16.629669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:16.630118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:16.630539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:16.644458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:16.646597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:16.652947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:16.653419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:16.653848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:16.654531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:16.654980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:16.655593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:16.684839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c6c6675-a164-43e7-82c7-cb615b7a26de tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 11 16:46:16.685392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 946/1618] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:16.692982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:16.701307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:16.703426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:16.704590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a0e81350-3635-40fb-bfe3-f399f5152d25 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088344 Aug 11 16:46:16.705133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 673/1619] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:17.698015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:17.700176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:17.707286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:17.707758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:17.708220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:17.708901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:17.709345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:17.709765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:17.726749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:17.727351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:17.734413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:17.734891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:17.735323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:17.736008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:17.736472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:17.736887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:17.739211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81a0101e-99fa-4a2b-9e6e-dcb522d1568c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Aug 11 16:46:17.739768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 947/1620] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:17.801018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:17.809419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:17.810921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:17.813604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8843c36b-c408-43b4-8c8d-a6e23f4a3674 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090778 Aug 11 16:46:17.814162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 674/1621] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:18.751567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:18.753711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:18.760122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:18.760603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:18.761056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:18.761733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:18.762180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:18.762598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:18.793193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99d6af4f-b506-40ed-84c8-445357240cc1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Aug 11 16:46:18.793735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 948/1622] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:18.836144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:18.836758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:18.843777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:18.844276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:18.844706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:18.845412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:18.845854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:18.846269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:18.909387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:18.917747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:18.919240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:18.920406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7cae5998-9485-4a7e-8cf9-ab7ea401a36a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088155 Aug 11 16:46:18.921283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 675/1623] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:19.805517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:19.807644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:19.815068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:19.815544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:19.815975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:19.816686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:19.817137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:19.817554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:19.846739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c36103bb-74e7-4e15-b696-de35ccfcf2c6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Aug 11 16:46:19.847286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 949/1624] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:19.943836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:19.944443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:19.950828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:19.951299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:19.951728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:19.953163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:19.953527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:19.953944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:20.014197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:20.022565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:20.024061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:20.025211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7b0ee658-6dbc-4df6-afdf-036f47c894ff tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085381 Aug 11 16:46:20.025751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 676/1625] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:20.859449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:20.861642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:20.868016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:20.868522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:20.868950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:20.869627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:20.870072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:20.870489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:20.899943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2d41f38-136c-41be-a7ab-f367b56ef1b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 11 16:46:20.900522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 950/1626] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:21.048950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:21.049590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:21.056126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:21.056615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:21.057299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:21.057729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:21.058174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:21.058594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:21.120343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:21.129427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:21.130933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:21.132072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7ea54a72-0c85-438b-a290-a219869396a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088111 Aug 11 16:46:21.132653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 677/1627] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:21.912107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:21.914330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:21.920740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:21.921294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:21.921743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:21.922429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:21.922881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:21.923307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:21.953240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-82bd582a-4604-4122-ab5d-fd878ecac89e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 11 16:46:21.953796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 951/1628] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:22.156313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:22.156904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:22.163327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:22.163799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:22.164258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:22.164939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:22.165382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:22.165801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:22.229859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:22.232064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:22.239951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:22.241473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:22.242618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d7b9e7da-b4be-4d80-bc82-8cc5a9b37028 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091102 Aug 11 16:46:22.243173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 678/1629] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:22.965421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:22.967540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:22.973983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:22.974459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:22.974891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:22.975565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:22.976011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:22.976456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:23.005834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9f4f59c8-3cf2-49a7-8997-bbe6847f3146 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 11 16:46:23.006382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 952/1630] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:23.265862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:23.266479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:23.273008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:23.273492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:23.273931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:23.274623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:23.275092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:23.275502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:23.337358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:23.346516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:23.348010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:23.349176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-60c96e6a-0b8c-47bb-9536-b8f9f03d4456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087962 Aug 11 16:46:23.349730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 679/1631] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:23.784304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:46:23.784493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:46:24.018180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:24.020261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:24.026649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:24.027115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:24.027548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:24.028268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:24.028720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:24.029145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:24.060271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9c2aebb8-24f1-4a34-9888-2ff0bfa67a27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Aug 11 16:46:24.060849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 953/1632] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:24.371833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:24.372619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:24.375653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=54 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:24.380868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:24.381343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:24.381771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:24.382453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:24.383015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:24.383440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:24.444745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:24.453742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:24.455255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:24.456438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e57fa306-f2f2-44fd-9c0e-70594d432f63 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088430 Aug 11 16:46:24.457012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 680/1633] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:25.073194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:25.075393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:25.082349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:25.082834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:25.083269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:25.083974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:25.084454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:25.084886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:25.110972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:25.115899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f556a73d-a147-4a1c-a329-e23547acbc23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Aug 11 16:46:25.116486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 954/1634] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:25.478718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:25.479245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:25.486261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:25.486736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:25.487169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:25.487857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:25.488346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:25.488800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:25.552549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:25.560844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:25.563064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:25.564277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-63aad3cc-ee59-4d31-82b8-6af6b5725fc8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089552 Aug 11 16:46:25.564831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 681/1635] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:26.128489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:26.130626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:26.137240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:26.137721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:26.138156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:26.138844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:26.139295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:26.140389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:26.169782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afcf710f-6093-4531-883a-dfc26b229274 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Aug 11 16:46:26.170320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 955/1636] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:26.585811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:26.586414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:26.593456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:26.593926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:26.594354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:26.595031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:26.595474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:26.595891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:26.658549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:26.666822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:26.668330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:26.669458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-beedad99-343e-46eb-b8e3-d9c8f43fc644 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087517 Aug 11 16:46:26.670004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 682/1637] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:27.181823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:27.183962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:27.190817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:27.191290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:27.191722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:27.192427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:27.192874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:27.193294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:27.221735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6ea7c39e-ee95-442f-9bc9-a0d5d6b3306c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 11 16:46:27.222267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 956/1638] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:27.691899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:27.692699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:27.699203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:27.699693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:27.700147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:27.700854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:27.701313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:27.701735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:27.785386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:27.799720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:27.801287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:27.802503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1c0ff96d-ebf8-4146-bf5f-0c978921cd27 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.114630 Aug 11 16:46:27.803062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 683/1639] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:28.233660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:28.235807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:28.241784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:28.242255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:28.242681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:28.243362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:28.243806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:28.244246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:28.273387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68a026b0-40a8-4c16-834c-32b601e4eb3a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 11 16:46:28.273937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 957/1640] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:28.826508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:28.827762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:28.834318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:28.834793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:28.835227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:28.835918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:28.836403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:28.836828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:28.898194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:28.906730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:28.908284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:28.909435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-df130828-b442-4fe5-a4d9-3be104276f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086941 Aug 11 16:46:28.909985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 684/1641] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:29.286201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:29.288277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:29.294668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:29.295171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:29.296175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:29.297447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:29.297903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:29.298331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:29.330205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e2c9992-a6c9-4314-a052-e0e7c0c90e01 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047983 Aug 11 16:46:29.330764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 958/1642] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:29.931859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:29.932442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:29.940320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:29.940800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:29.941234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:29.941918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:29.942368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:29.942790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:30.007213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:30.015565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:30.017152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:30.018284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f5c78ef-2d5a-486c-852c-44443005e841 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090433 Aug 11 16:46:30.018841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 685/1643] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:30.342385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:30.345270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:30.351584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:30.352058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:30.352525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:30.353207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:30.353681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:30.354099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:30.383208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a2cc7562-8709-4328-a35f-6d299924c8b9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 11 16:46:30.383753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 959/1644] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:31.040710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:31.041319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:31.048663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:31.049141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:31.049570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:31.050259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:31.050706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:31.051129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:31.112296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:31.120638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:31.122144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:31.123281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1ba82afe-07ad-41b1-8345-911e855256db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086639 Aug 11 16:46:31.123858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 686/1645] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:31.395830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:31.397986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:31.404386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:31.404867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:31.406151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:31.406922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:31.407375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:31.407800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:31.436089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c7cb2b1-5c6b-402b-b874-ceb2d4c0f5b3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Aug 11 16:46:31.437405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 960/1646] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:32.146273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:32.146877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:32.153023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:32.153503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:32.153936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:32.154618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:32.155689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:32.156240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:32.216211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:32.225155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:32.226662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:32.227807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f12887b-8eea-4eee-870c-be9096be44ea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085449 Aug 11 16:46:32.228416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 687/1647] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:32.448962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:32.451008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:32.458535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:32.459016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:32.459451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:32.460165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:32.460621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:32.461045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:32.489794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc782d4d-85ae-434a-94e1-260a4149c732 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 Aug 11 16:46:32.490341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 961/1648] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:33.250201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:33.250790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:33.257246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:33.257730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:33.258166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:33.258858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:33.259312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:33.259739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:33.323935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:33.333281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:33.334781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:33.335914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4baf2c1-d463-4be5-a7dc-e8663725d3af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090265 Aug 11 16:46:33.336685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 688/1649] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:33.502411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:33.504480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:33.510942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:33.511424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:33.511860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:33.512575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:33.513027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:33.513449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:33.542070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2228b0c7-1deb-4bed-8107-7563d80f94fe tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 11 16:46:33.542617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 962/1650] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:34.358332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:34.358886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:34.365297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:34.365765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:34.366198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:34.366882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:34.367328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:34.367747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:34.431168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:34.439849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:34.441375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:34.442530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1f54eb72-4cb2-4436-b43b-c528f64a1be7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088240 Aug 11 16:46:34.443082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 689/1651] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:34.555095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:34.557268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:34.564546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:34.565023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:34.565454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:34.566136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:34.566585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:34.567002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:34.597277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-957b2066-34aa-4be8-805e-1ce94e0c2dc2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Aug 11 16:46:34.597815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 963/1652] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:35.465501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:35.466043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:35.472628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:35.473098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:35.473557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:35.474231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:35.474673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:35.475089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:35.536481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:35.544842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:35.546376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:35.547550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2a6a1547-cc17-4538-b5d5-ae094d32c4cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086087 Aug 11 16:46:35.548110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 690/1653] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:35.609440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:35.611597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:35.618009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:35.618485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:35.618914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:35.619624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:35.620070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:35.620514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:35.650676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6c999237-e7ce-45ae-81b3-fe9768a67347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 11 16:46:35.651212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 964/1654] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:36.570898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:36.571495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:36.578428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:36.578909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:36.579334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:36.580009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:36.580477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:36.580894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:36.641928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:36.650252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:36.651738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:36.652902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5ad58557-8c9d-4de1-906f-5d5438f3f9af tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085982 Aug 11 16:46:36.653453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 691/1655] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:36.663890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:36.665974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:36.672996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:36.673474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:36.673907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:36.674591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:36.675041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:36.675462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:36.706164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-63883c3e-3d50-4443-b1c8-c1100827653d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Aug 11 16:46:36.706703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 965/1656] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:37.676281 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:37.676865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:37.683284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:37.683758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:37.684228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:37.684919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:37.685364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:37.685787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:37.717771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:37.720717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:37.727144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:37.727621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:37.728051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:37.728773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:37.729217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:37.729635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:37.748296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:37.756740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:37.758250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:37.759408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f42a914-463c-403c-8b94-26c7f4282296 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087725 Aug 11 16:46:37.759606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c5e5f66-d477-4373-ae7d-6eabb0325f1f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Aug 11 16:46:37.759970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 692/1657] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:37.763200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 966/1658] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:38.771681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:38.773998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:38.780468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:38.781019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:38.781763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:38.781905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:38.782328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:38.782426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:38.782664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:38.783093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:38.789752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:38.790233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:38.790661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:38.791354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:38.791793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:38.792261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:38.814421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cb621296-b5bc-43f8-98c2-b9a8a81e44c1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Aug 11 16:46:38.814983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 693/1659] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:38.856354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:38.865351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:38.866845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:38.867976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ccc82d62-988c-4a52-b25a-f34e970e26a0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090214 Aug 11 16:46:38.868562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 967/1660] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:39.201171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:46:39.201339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:46:39.827011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:39.829196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:39.836945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:39.837448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:39.837873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:39.838587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:39.839043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:39.839464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:39.869757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-16991539-6723-4403-afd9-a7c455149ca5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Aug 11 16:46:39.870303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 694/1661] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:39.890698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:39.891239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:39.898462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:39.898962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:39.899392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:39.900068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:39.900541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:39.900960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:39.962470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:39.971161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:39.972692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:39.973826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce78a284-27d3-41f2-b7fe-74aa64d78316 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087092 Aug 11 16:46:39.974405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 968/1662] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:40.882175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:40.884360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:40.890719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:40.891194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:40.891624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:40.892332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:40.893314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:40.893843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:40.906979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:40.925426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-07e5a64c-5e5e-43ee-9884-9af677363a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Aug 11 16:46:40.925974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 695/1663] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:40.996123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:40.996732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:41.003200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:41.003682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:41.004138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:41.004828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:41.005279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:41.005702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:41.070161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:41.078851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:41.080963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:41.082242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55497adc-02fa-4ad8-86d0-488dde38fc7e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090056 Aug 11 16:46:41.082794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 969/1664] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:41.938046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:41.940794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:41.947132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:41.947607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:41.948032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:41.948734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:41.949179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:41.949597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:41.977495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0304d1d2-1d9f-4d3f-8a0e-ae9e38525daf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 11 16:46:41.978044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 696/1665] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:42.105185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:42.105820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:42.112992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:42.113469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:42.113898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:42.114576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:42.115023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:42.115442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:42.175757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:42.184153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:42.185661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:42.186805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-579c18a0-fd56-48a6-9498-a6e89d8bcedb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085481 Aug 11 16:46:42.187612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 970/1666] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:42.990755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:42.992926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:42.999318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:42.999798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:43.000273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:43.000965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:43.001420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:43.001844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:43.030180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5694fabd-c408-4061-a08d-3a6148c24b55 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Aug 11 16:46:43.030732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 697/1667] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:43.210042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:43.210648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:43.217114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:43.217574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:43.218005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:43.218694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:43.219144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:43.219565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:43.234935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:43.283427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:43.292689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:43.294185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:43.295323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6ed071c-4c95-46bc-bbb5-d645a0301de5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089936 Aug 11 16:46:43.295879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 971/1668] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:44.043420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:44.045620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:44.052972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:44.053486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:44.053926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:44.054623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:44.055073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:44.055497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:44.085306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a0e7f0bf-6f10-4ca1-83bd-cc6d9a7ea1aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Aug 11 16:46:44.085851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 698/1669] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:44.317913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:44.318514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:44.324924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:44.325399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:44.325823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:44.326574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:44.327028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:44.327439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:44.387400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:44.395629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:44.397144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:44.398271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33eb8997-8880-4b84-a333-75a92443d34f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084370 Aug 11 16:46:44.398819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 972/1670] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:45.098027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:45.100239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:45.106668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:45.107149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:45.107586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:45.108310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:45.108762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:45.109206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:45.138301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4c0680b8-df9a-498a-80a4-d4b3bf392595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 11 16:46:45.138849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 699/1671] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:45.422989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:45.423606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:45.430779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:45.431313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:45.431746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:45.432555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:45.433035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:45.433839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:45.507371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:45.515900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:45.517456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:45.519303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd64e934-821d-4553-b687-14e9e1ef1f13 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.102225 Aug 11 16:46:45.519864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 973/1672] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:46.150685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:46.152858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:46.159694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:46.160215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:46.160652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:46.161342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:46.161792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:46.162215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:46.193045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e59f91c4-cfba-4d54-a8af-844d8f1ca829 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Aug 11 16:46:46.193598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 700/1673] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:46.542819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:46.543387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:46.545669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=58 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:46.551557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:46.552072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:46.552510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:46.553192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:46.553655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:46.554056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:46.614951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:46.623239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:46.624778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:46.625905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8d90fe95-2eb8-4936-9f29-15aa94422ac8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087098 Aug 11 16:46:46.626462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 974/1674] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:47.205930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:47.208265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:47.214745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:47.215222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:47.215653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:47.216365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:47.216814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:47.217236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:47.246294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-91da1eb9-458f-4600-a8ad-eafd4a6d7eef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Aug 11 16:46:47.246839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 701/1675] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:47.649639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:47.650249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:47.656818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:47.657298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:47.657725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:47.658400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:47.658965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:47.659383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:47.719716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:47.728381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:47.729882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:47.731018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f274be7-0b47-4e4d-b0f6-1c518a6e1c0f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085314 Aug 11 16:46:47.731570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 975/1676] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:48.258780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:48.260960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:48.267249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:48.267725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:48.268296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:48.269004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:48.269444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:48.269858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:48.298436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5057e94b-8853-4ace-a304-f4576b8460b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Aug 11 16:46:48.298982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 702/1677] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:48.756404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:48.757020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:48.763526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:48.764007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:48.764476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:48.765168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:48.765622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:48.766052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:48.829994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:48.839003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:48.840569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:48.841715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bfd81339-1dff-41ae-966b-7a888c1d4fcc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089836 Aug 11 16:46:48.842268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 976/1678] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:49.312343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:49.314479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:49.321011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:49.321495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:49.321930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:49.322620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:49.323069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:49.323490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:49.353748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ca09a384-dcdd-41bf-bdc3-a5ec23eac8b1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Aug 11 16:46:49.354306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 703/1679] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:49.865242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:49.865854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:49.872288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:49.872768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:49.873204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:49.873884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:49.874335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:49.874760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:49.941588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:49.953353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:49.954862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:49.957143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-68b5e8b5-6194-454f-96d0-831bc9c728b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.096939 Aug 11 16:46:49.957699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 977/1680] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:50.367406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:50.370177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:50.377778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:50.378359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:50.378795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:50.379491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:50.379930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:50.380369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:50.410069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f8f4602-0b47-4871-9962-3790720f50b0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047294 Aug 11 16:46:50.410624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 704/1681] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:50.980134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:50.980785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:50.987406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:50.987887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:50.988352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:50.989038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:50.989490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:50.989909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:51.203928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:51.212903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:51.214398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:51.215569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-326fbe2b-f127-4d1c-bc93-49aaf823c5ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.239409 Aug 11 16:46:51.216142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 978/1682] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:51.422282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:51.424977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:51.431274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:51.431747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:51.432210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:51.432894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:51.433337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:51.433751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:51.462891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dd762265-6d82-4257-9173-08464f29e87c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 11 16:46:51.463430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 705/1683] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:52.239198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:52.239809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:52.246285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:52.246772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:52.247209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:52.247902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:52.248387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:52.248816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:52.310011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:52.318596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:52.320128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:52.321264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22004748-0eb7-49f4-adbb-e5aa67f64dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086801 Aug 11 16:46:52.321816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 979/1684] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:52.475824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:52.478093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:52.484866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:52.485353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:52.485790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:52.486483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:52.487216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:52.487651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:52.516701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aa8af993-1a90-4173-9d05-fa9d58d6dc41 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Aug 11 16:46:52.517256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 706/1685] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:53.344170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:53.344722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:53.351750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:53.352261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:53.352699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:53.353389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:53.353840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:53.354264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:53.415593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:53.424083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:53.426143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:53.427288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba044d44-4165-401c-b133-7cc6f2070d80 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087085 Aug 11 16:46:53.427839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 980/1686] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:53.528770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:53.530982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:53.538000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:53.538477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:53.538915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:53.539603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:53.540057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:53.540514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:53.570372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3f543aa7-6bb7-43f8-9619-b14b6fe15ef1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Aug 11 16:46:53.570941 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 707/1687] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:54.451416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:54.451933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:54.458426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:54.458911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:54.459344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:54.460033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:54.460516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:54.460934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:54.524525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:54.532893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:54.535271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:54.536447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3f14092-cd88-41d1-a353-a2ad2f604dd8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089052 Aug 11 16:46:54.536999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 981/1688] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:54.583464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:54.585654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:54.587982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:54.593779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:54.594284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:54.594745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:54.595426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:54.596942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:54.597166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:54.625641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7322a06b-9d14-484e-9017-6c44b5c190ac tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 11 16:46:54.626188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 708/1689] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:55.558702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:55.559315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:55.566710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:55.567190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:55.567619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:55.568341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:55.568793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:55.569217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:55.629638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:55.637882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:55.638334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:55.639762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:55.640039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:55.641003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ff27d3fb-dc8e-4ad2-8e77-ef0df125e672 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086269 Aug 11 16:46:55.641639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 982/1690] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:55.647076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:55.647549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:55.647978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:55.648771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:55.649214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:55.649633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:55.680523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1aa9da47-168a-4406-b34f-10f59f11c5a4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Aug 11 16:46:55.681065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 709/1691] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:56.663820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:56.664463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:56.670888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:56.671372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:56.671813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:56.672538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:56.672999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:56.673427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:56.693373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:56.695527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:56.701882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:56.702356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:56.702785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:56.703467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:56.703911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:56.704356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:56.733991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4504f456-c0b3-4f32-9507-81000ebb3fa0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 11 16:46:56.733991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 710/1692] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:46:56.736023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:56.745073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:56.746625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:56.747784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-557a48ac-4dd7-4f41-b79e-6a9fbdfb3ed7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087897 Aug 11 16:46:56.748371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 983/1693] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:57.745938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:57.748075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:57.755289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:57.755761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:57.756218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:57.756900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:57.757343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:57.757763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:57.770934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:57.771663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:57.778201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:57.778698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:57.779126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:57.780288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:57.780742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:57.781190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:57.787840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5b431d94-96a7-4a4e-8434-befbc4716793 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Aug 11 16:46:57.788431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 711/1694] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:57.844170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:57.853293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:57.854772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:57.855894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e599bd35-1db3-48f5-a363-56f612de00a7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089072 Aug 11 16:46:57.856553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 984/1695] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:46:58.800018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:58.802275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:58.808733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:58.809216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:58.809655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:58.810349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:58.810802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:58.811231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:58.813875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:46:58.840870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-10fe7cdf-0370-4048-a694-6a058e193435 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 11 16:46:58.841434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 712/1696] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:58.878988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:58.879591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:58.886097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:58.886570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:58.886995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:58.887678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:58.888151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:58.888573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:58.953407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:58.962224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:58.963750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:46:58.964920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d991db5f-4e37-4a6b-9957-e1864a9ef095 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090186 Aug 11 16:46:58.965479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 985/1697] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:46:59.853089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:59.855248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:59.862499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:59.862985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:59.863422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:59.864137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:59.864596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:59.865022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:59.894298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7875200e-8e03-4fa2-9103-f925905afa50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Aug 11 16:46:59.894781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 713/1698] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:46:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:46:59.988211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:46:59.988832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:46:59.995290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:59.995775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:59.996248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:46:59.996943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:46:59.997397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:46:59.997853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:00.059408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:00.068385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:00.069879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:00.071020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b716fa1d-e2b5-48cc-9d34-33114e7b627f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087535 Aug 11 16:47:00.071567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 986/1699] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:46:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:00.906772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:00.909044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:00.915432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:00.915911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:00.916385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:00.917077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:00.917529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:00.917954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:00.947119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-02fedcfc-6ba9-4b00-a96d-4ddedb65320e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 11 16:47:00.947666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 714/1700] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:01.092860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:01.093475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:01.100248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:01.100734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:01.101167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:01.101849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:01.102297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:01.102714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:01.163308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:01.171602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:01.173138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:01.174802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c0227b24-86e6-4139-a35e-aa07c540ac9f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085876 Aug 11 16:47:01.175354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 987/1701] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:01.959521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:01.961779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:01.967693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:01.968205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:01.968638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:01.969320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:01.969764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:01.970179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:01.999660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0f0aec3d-9eaf-4226-9b40-68307d345389 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Aug 11 16:47:02.000225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 715/1702] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:02.197967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:02.198614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:02.205621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:02.206180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:02.206616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:02.207313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:02.207773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:02.208225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:02.212224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:02.270056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:02.278403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:02.279948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:02.281129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d8316d4c-d15f-4237-bd08-57cdfeea4eea tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087107 Aug 11 16:47:02.281679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 988/1703] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:03.012764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:03.014906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:03.024737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:03.025221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:03.025657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:03.026344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:03.026795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:03.027219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:03.060088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0f3ed188-7844-4e4c-a598-96d6ee2dfbc0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051366 Aug 11 16:47:03.060668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 716/1704] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:03.304193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:03.304813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:03.311246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:03.311734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:03.312451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:03.313143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:03.313595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:03.314023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:03.378413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:03.386747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:03.388319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:03.389464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8034ff34-ffcc-4fb1-ac81-40248a4033f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090163 Aug 11 16:47:03.390019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 989/1705] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:04.072981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:04.075118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:04.081577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:04.082053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:04.082488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:04.083172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:04.083621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:04.084042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:04.113172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7db30c81-97a9-4f5c-8bb7-afa260b32e3e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Aug 11 16:47:04.113719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 717/1706] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:04.414172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:04.414741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:04.421217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:04.421703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:04.422166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:04.422865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:04.423320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:04.423759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:04.486964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:04.495312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:04.496865 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:04.498045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e2bff177-f5e4-4fdb-b445-911741dfb8eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087931 Aug 11 16:47:04.498599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 990/1707] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:05.124612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:05.127437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:05.133831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:05.134321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:05.134757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:05.135446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:05.135899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:05.136354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:05.165948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aa764b6c-2ee5-4385-a9c6-82f4657a29b4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Aug 11 16:47:05.166490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 718/1708] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:05.521471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:05.522001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:05.528471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:05.528956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:05.529390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:05.530082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:05.530536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:05.530960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:05.592742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:05.601743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:05.603239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:05.604404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b876b27d-ff2d-4b19-89e0-fd3f7d851ff1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087572 Aug 11 16:47:05.604949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 991/1709] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:06.178339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:06.180487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:06.186857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:06.187591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:06.188018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:06.188721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:06.189744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:06.190164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:06.219039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2094ad42-3319-4dce-9dcc-4ef7a035980d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Aug 11 16:47:06.219584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 719/1710] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:06.626913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:06.627784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:06.634947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:06.635427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:06.635854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:06.636563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:06.637007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:06.637424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:06.699493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:06.708082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:06.709594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:06.710731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbf32dd7-47cd-41e8-b032-b53da5554573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087845 Aug 11 16:47:06.711314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 992/1711] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:07.231388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:07.233573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:07.240882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:07.241358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:07.241810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:07.242518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:07.242990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:07.243436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:07.272744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-393a1a9a-0a5a-4f3c-a6eb-1ffeada1fead tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 Aug 11 16:47:07.273295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 720/1712] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:07.733381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:07.733986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:07.741043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:07.741520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:07.741950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:07.742628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:07.743074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:07.743493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:07.806626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:07.815521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:07.817078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:07.818262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29fddba0-9239-4f5c-9586-a20a6b07307c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088829 Aug 11 16:47:07.818816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 993/1713] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:08.209589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:47:08.209772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:47:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:47:08.285411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:08.287541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:08.293973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:08.294446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:08.294877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:08.295674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:08.296146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:08.296570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:08.325737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc0d675c-629f-499c-85eb-0159b4d063ad tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Aug 11 16:47:08.326206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 721/1714] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:08.841196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:08.841811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:08.849297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:08.849776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:08.850212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:08.850908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:08.851359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:08.851784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:08.912711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:08.921046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:08.922565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:08.923795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e942c146-cc1a-4e46-abe5-f9dc1d383f20 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086433 Aug 11 16:47:08.924549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 994/1715] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:09.338052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:09.340243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:09.347159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:09.347637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:09.348075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:09.348790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:09.349245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:09.349669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:09.378876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c2ecccec-493d-49ed-a757-a510d371e066 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Aug 11 16:47:09.379433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 722/1716] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:09.947114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:09.947639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:09.954055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:09.954532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:09.955066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:09.955794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:09.956270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:09.956697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:10.017851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:10.026200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:10.027708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:10.028889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9cc5d7ae-7543-4009-84d5-8d315d1fd361 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085770 Aug 11 16:47:10.029441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 995/1717] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:10.390657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:10.393327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:10.400020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:10.400486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:10.400921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:10.401615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:10.402720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:10.402720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:10.433188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-94414d16-9fe0-4b66-a69d-39290b994ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Aug 11 16:47:10.434147 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 723/1718] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:11.052773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:11.053394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:11.059853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:11.060370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:11.060811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:11.061511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:11.061963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:11.062651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:11.122731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:11.132127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:11.133657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:11.134807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c1dc2ba1-9cf5-484e-afd4-452a894d6496 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086563 Aug 11 16:47:11.135362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 996/1719] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:11.445885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:11.447940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:11.454388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:11.455467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:11.455912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:11.456636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:11.457093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:11.457536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:11.488378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c068f8ea-7328-4e1b-ae8b-e34230d442f6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Aug 11 16:47:11.488968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 724/1720] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:12.158578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:12.159235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:12.165593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:12.166067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:12.166496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:12.167176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:12.167626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:12.168046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:12.233236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:12.242692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:12.244220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:12.245364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e9762af2-1cb6-4f0e-88e8-4b5be808bab9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091329 Aug 11 16:47:12.245919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 997/1721] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:12.501453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:12.503531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:12.509971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:12.510450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:12.510880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:12.511568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:12.512013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:12.512531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:12.542545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-67fa50e9-b340-4294-89be-7c2ff28127df tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Aug 11 16:47:12.543084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 725/1722] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:13.268780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:13.269444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:13.275911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:13.276432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:13.276873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:13.277566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:13.278020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:13.278443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:13.339354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:13.348889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:13.350402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:13.351541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0b400077-dade-4374-9c36-4dcb814bdd7b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087355 Aug 11 16:47:13.352090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 998/1723] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:13.555046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:13.557229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:13.564464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:13.564955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:13.565376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:13.566054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:13.566507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:13.566919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:13.596357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c9a115a8-4368-4a51-89d9-2d1843e0aad3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Aug 11 16:47:13.596838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 726/1724] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:14.374079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:14.374603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:14.381765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:14.382241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:14.382673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:14.383355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:14.383861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:14.384330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:14.445873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:14.454218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:14.456368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:14.457508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-588b8303-0d41-44dd-8efe-2e8ac993c5cf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087477 Aug 11 16:47:14.458060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 999/1725] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:14.608380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:14.610581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:14.618087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:14.618565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:14.619001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:14.619689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:14.620169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:14.620594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:14.650278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d570928c-0480-4928-9bf8-f642a006ecf9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Aug 11 16:47:14.650754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 727/1726] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:15.479892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:15.480538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:15.487091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:15.487580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:15.488016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:15.488744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:15.489208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:15.489623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:15.550277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:15.558627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:15.560171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:15.561323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-011b05c6-8219-4dea-8214-c9f97c808d8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085416 Aug 11 16:47:15.561877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1000/1727] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:15.662592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:15.664785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:15.671149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:15.671628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:15.672068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:15.672777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:15.673955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:15.674664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:15.699866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:15.704976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ecfab8cb-0e3c-49ac-b248-f12a52b7bb20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Aug 11 16:47:15.705974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 728/1728] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:16.584531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:16.585158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:16.587438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=54 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:16.593186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:16.593672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:16.594110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:16.594833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:16.595413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:16.595843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:16.659771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:16.668158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:16.669675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:16.670818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e1e3a1e8-9b86-4788-9a1d-7457e62d65bc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090224 Aug 11 16:47:16.671378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1001/1729] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:16.717198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:16.719333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:16.725918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:16.726396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:16.726836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:16.727522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:16.727971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:16.728418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:16.757596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-734a44bc-accc-4824-9866-1bb95a337c28 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Aug 11 16:47:16.758151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 729/1730] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:17.693358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:17.693966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:17.700384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:17.700861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:17.701290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:17.701973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:17.702419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:17.702839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:17.764941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:17.771019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:17.773253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:17.774297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:17.775674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:17.776848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0cda86b2-c5c3-4fab-bc22-2afe136720c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087400 Aug 11 16:47:17.777395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1002/1731] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:17.779498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:17.779975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:17.780438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:17.781132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:17.781614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:17.782035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:17.813427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a0ed978-abb8-4d77-a654-73052e214f71 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Aug 11 16:47:17.814430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 730/1732] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:47:18.800596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:18.801239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:18.807746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:18.808266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:18.808703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:18.809392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:18.809843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:18.810267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:18.826030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:18.828318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:18.835052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:18.835531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:18.835967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:18.836688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:18.837142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:18.837569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:18.868484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d2d1027b-6e4e-434f-8579-1153d9490acb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Aug 11 16:47:18.869063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 731/1733] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:47:18.874028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:18.882706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:18.884229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:18.885399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d09a3405-2386-4c09-bb2f-d5337ac3239d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089378 Aug 11 16:47:18.885942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1003/1734] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:19.881390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:19.883530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:19.889941 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:19.890363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:19.890793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:19.891476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:19.892084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:19.892589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:19.907165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:19.908269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:19.915613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:19.916118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:19.916562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:19.917256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:19.917710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:19.918159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:19.922008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac629ed8-0db4-427f-afc3-1a18a968164f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Aug 11 16:47:19.922568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 732/1735] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:19.984382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:19.987056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:19.994887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:19.996434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:19.997594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a0f5743-a354-4e29-af1f-1e9fb5a4f4d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.094275 Aug 11 16:47:19.998142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1004/1736] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:47:20.934997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:20.937511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:20.943969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:20.945163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:20.945606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:20.946307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:20.946772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:20.947191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:20.977133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d8447c86-60be-4092-bee9-bd8d63e00088 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Aug 11 16:47:20.977690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 733/1737] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:21.021117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:21.021728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:21.028219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:21.028696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:21.029129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:21.029811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:21.030264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:21.030678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:21.095222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:21.103688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:21.105245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:21.106390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-268cb92f-8176-4e6f-9e41-b5f329016151 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089895 Aug 11 16:47:21.106942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1005/1738] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:21.989464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:21.991640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:21.998130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:21.998616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:21.999289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:21.999991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:22.000482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:22.000911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:22.034587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e47900a1-0d03-451f-bae4-ac8d3ebc9c06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Aug 11 16:47:22.035257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 734/1739] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:22.129498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:22.130151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:22.137069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:22.137413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:22.137889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:22.138539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:22.138986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:22.139405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:22.203085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:22.211482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:22.212998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:22.214136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8617511-b3c1-42e0-b18f-8748b5e5d196 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089469 Aug 11 16:47:22.214690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1006/1740] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:23.046899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:23.049169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:23.055482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:23.055956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:23.056416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:23.057439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:23.057547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:23.057966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:23.087369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3dbbc00a-cd2c-4b9e-ad44-c88187bb700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 11 16:47:23.087913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 735/1741] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:23.237012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:23.237626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:23.244176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:23.244670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:23.245108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:23.245860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:23.246261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:23.246686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:23.309214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:23.317948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:23.319459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:23.320628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f230d45a-59aa-4e10-8cf3-6a81c850910b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088153 Aug 11 16:47:23.321182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1007/1742] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:24.099967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:24.102176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:24.108654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:24.109127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:24.109557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:24.110237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:24.110680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:24.111098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:24.139953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6a7f1fea-80d2-4619-9f0d-5ae21e78df5a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Aug 11 16:47:24.140529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 736/1743] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:24.343356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:24.343900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:24.351196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:24.351685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:24.352147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:24.352884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:24.353337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:24.353764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:24.414504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:24.422916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:24.425010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:24.426162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47df3694-b9fd-4473-918f-2482bd822954 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086828 Aug 11 16:47:24.426712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1008/1744] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:25.152142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:25.154288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:25.156620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=58 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:25.162212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:25.162685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:25.163118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:25.163802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:25.164285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:25.164708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:25.194557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e3b755ef-4e73-46f3-8403-a9dd46f80a3d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046410 Aug 11 16:47:25.195105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 737/1745] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:25.448294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:25.448869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:25.455896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:25.456403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:25.456840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:25.457531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:25.457985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:25.458409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:25.522264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:25.530590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:25.532079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:25.533236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-369d0c93-286d-4c44-8cdb-bd53b3c0a7d0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088981 Aug 11 16:47:25.533784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1009/1746] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:26.207255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:26.209412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:26.215758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:26.216261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:26.216689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:26.217366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:26.217810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:26.218228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:26.247010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-76652e36-e424-4f97-bea1-e36909a3b19c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Aug 11 16:47:26.247546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 738/1747] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:26.555514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:26.556176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:26.562872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:26.563359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:26.563795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:26.565010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:26.565472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:26.565897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:26.628417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:26.636803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:26.638318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:26.639460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5f4ea284-778c-4c71-821c-539c77bd2f88 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087857 Aug 11 16:47:26.640020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1010/1748] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:27.259171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:27.261344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:27.268331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:27.268886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:27.269298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:27.269978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:27.270423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:27.270846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:27.299798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3510cf58-4e2e-41dd-8ad5-bc93cd41ff61 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Aug 11 16:47:27.300380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 739/1749] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:27.662028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:27.662636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:27.669046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:27.669524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:27.669958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:27.670646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:27.671100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:27.671524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:27.732382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:27.741230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:27.742740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:27.743877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a6c12876-cf76-4dd2-9032-1d1eeacdcff6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086053 Aug 11 16:47:27.744453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1011/1750] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:28.312448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:28.314729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:28.321201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:28.321688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:28.322126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:28.322826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:28.323279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:28.323705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:28.353396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4ab32072-b573-4e5d-9ef4-c19aec1e3750 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Aug 11 16:47:28.353957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 740/1751] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:28.766441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:28.767032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:28.773883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:28.774359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:28.774794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:28.775534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:28.775994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:28.776438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:28.843236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:28.852298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:28.853797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:28.854942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-260a7cef-dfde-4625-9c9f-d17f80b40a5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092927 Aug 11 16:47:28.855486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1012/1752] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:29.366515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:29.368594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:29.375011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:29.375483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:29.375913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:29.376623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:29.377064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:29.377490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:29.405892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-707e6572-e318-4ab7-8609-2155ec7df238 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 11 16:47:29.406450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 741/1753] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:29.879239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:29.879826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:29.886625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:29.887101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:29.887529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:29.888235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:29.888680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:29.889100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:29.952663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:29.961532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:29.963023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:29.964184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3f2a926-90df-455e-b573-db2cd18439f5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090834 Aug 11 16:47:29.964727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1013/1754] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:30.418930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:30.421162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:30.428146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:30.428629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:30.429065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:30.429751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:30.430200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:30.430621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:30.461401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f81c01c0-3fdb-4853-bbea-a4702772e6b2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Aug 11 16:47:30.461965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 742/1755] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:30.989113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:30.989723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:30.996153 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:30.996636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:30.997071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:30.997762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:30.998214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:30.998674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:31.059875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:31.068771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:31.070294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:31.071447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aca17671-4b51-45b6-8912-910be841247f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087214 Aug 11 16:47:31.072011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1014/1756] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:31.474762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:31.476918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:31.483308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:31.483790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:31.484256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:31.484947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:31.485398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:31.485821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:31.515541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1ee16fe2-1fd5-49b9-8008-6f2601921a68 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Aug 11 16:47:31.516093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 743/1757] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:32.094130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:32.094750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:32.101546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:32.102037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:32.102479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:32.103181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:32.103635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:32.104064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:32.163949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:32.172764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:32.174821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:32.175962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7fae64e2-a54a-40b3-b4ff-99ed2525aef2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085814 Aug 11 16:47:32.176559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1015/1758] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:32.529069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:32.531194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:32.538143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:32.538614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:32.539046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:32.539721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:32.540189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:32.540611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:32.570080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-660c6de9-27fe-44cc-b92f-a7c0aadec67e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Aug 11 16:47:32.570621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 744/1759] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:33.199444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:33.200013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:33.206641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:33.207122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:33.207561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:33.208295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:33.208757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:33.209206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:33.269057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:33.277421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:33.278936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:33.280129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4632e10c-0aaf-452b-bf0a-6db77abe7de8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084683 Aug 11 16:47:33.280753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1016/1760] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:33.582869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:33.585074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:33.591424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:33.591904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:33.592374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:33.593067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:33.593517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:33.593948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:33.608180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:33.623791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41bf22d4-bf70-43c6-a238-80cef0a2b6f3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Aug 11 16:47:33.624384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 745/1761] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:34.304188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:34.304799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:34.311191 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:34.311665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:34.312355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:34.313052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:34.313498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:34.313992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:34.379835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:34.388207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:34.389708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:34.390846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5f21e10-ba8f-4480-9fcc-fdcb4365ed32 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090634 Aug 11 16:47:34.391402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1017/1762] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:34.635962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:34.638082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:34.644671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:34.645146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:34.645579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:34.646262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:34.646713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:34.647133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:34.676389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-eea3eaef-b200-4add-87c2-9d64195a99d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Aug 11 16:47:34.676941 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 746/1763] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:35.414168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:35.414729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:35.421131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:35.421606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:35.422034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:35.422718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:35.423164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:35.423621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:35.484322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:35.493616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:35.495106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:35.496268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f253251a-777c-4c1d-8997-45f27ec8d11b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086096 Aug 11 16:47:35.496818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1018/1764] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:35.689260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:35.691381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:35.697793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:35.698273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:35.698723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:35.699398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:35.699848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:35.700302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:35.729647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c7c13c58-27af-4c25-9cae-60b951603a50 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Aug 11 16:47:35.730201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 747/1765] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:36.519476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:36.520051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:36.526445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:36.526920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:36.527352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:36.528041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:36.528520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:36.528945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:36.591158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:36.600239 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:36.601726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:36.602861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e496da70-2261-45ad-b21a-263e7c045da2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088600 Aug 11 16:47:36.603409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1019/1766] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:36.742058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:36.744247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:36.750673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:36.751151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:36.752119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:36.752816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:36.753268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:36.753694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:36.783050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c8b5c5f3-b342-49bd-9601-62ec41715fa5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Aug 11 16:47:36.783632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 748/1767] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:37.624969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:37.625612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:37.632655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:37.633130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:37.633557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:37.634234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:37.634680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:37.635098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:37.696062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:37.705258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:37.706775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:37.707923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c57ee35-8204-455e-9b89-3d8e9bb8bd67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086837 Aug 11 16:47:37.708518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1020/1768] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:37.794494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:37.796691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:37.803286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:37.803766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:37.804231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:37.804919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:37.805362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:37.805777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:37.835590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a65df826-25e6-42bb-bffb-832046155521 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Aug 11 16:47:37.836152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 749/1769] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:38.730321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:38.730966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:38.737624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:38.738110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:38.738546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:38.739235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:38.739688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:38.740132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:38.754747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:38.803878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:38.812588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:38.814139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:38.815283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29ca56db-52c0-4262-94b2-b1a0be48f081 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088902 Aug 11 16:47:38.815843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1021/1770] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:38.848520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:38.850689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:38.857138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:38.857611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:38.858040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:38.858718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:38.859162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:38.859575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:38.887955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e4903e40-5ff4-465a-9ead-30d200c9e2dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Aug 11 16:47:38.888518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 750/1771] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:39.837948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:39.838564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:39.845603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:39.846098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:39.846537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:39.847231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:39.847686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:39.848133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:39.900504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:39.902666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:39.909915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:39.910327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:39.910491 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:39.910817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:39.911504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:39.911948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:39.912401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:39.918854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:39.920708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:39.921852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fafa4a96-2c1e-42cc-a1f6-d321c67b582a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087841 Aug 11 16:47:39.922433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1022/1772] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:39.941874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ed521005-1797-45b4-a27f-f7c06d142f65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Aug 11 16:47:39.942414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 751/1773] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:47:40.945990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:40.946589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:40.952761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:40.953235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:40.953365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:40.953780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:40.954403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:40.954893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:40.955463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:40.955623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:40.962014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:40.962487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:40.962921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:40.963605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:40.964050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:40.964495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:40.993851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0198edde-8508-429e-861c-34b5f3d0ede5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 11 16:47:40.994420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 752/1774] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:47:41.020957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:41.029347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:41.030833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:41.031958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4b7af10c-b0c2-45e1-8f31-68902ed0e8dc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089906 Aug 11 16:47:41.032550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1023/1775] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:42.006179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:42.008340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:42.014758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:42.015243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:42.015681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:42.016407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:42.017466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:42.017911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:42.046351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fd161558-aa85-4683-9512-152f1446170b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Aug 11 16:47:42.046914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 753/1776] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:42.054668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:42.055281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:42.061887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:42.062631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:42.063064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:42.064342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:42.065163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:42.065590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:42.125884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:42.135314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:42.136864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:42.138013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37fd4a52-81b6-442c-a62e-b09ffa5ff96e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087257 Aug 11 16:47:42.138577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1024/1777] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:43.058670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:43.060818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:43.067710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:43.068209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:43.068647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:43.069322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:43.069767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:43.070183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:43.100003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-64054704-9e33-47d5-8e5e-7650d76a690d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Aug 11 16:47:43.100576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 754/1778] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:43.162152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:43.162792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:43.169181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:43.169652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:43.170076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:43.170752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:43.171199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:43.171613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:43.235379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:43.243886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:43.245430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:43.246580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ef6442c-fcc5-4801-bb94-6ca2198121d1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089098 Aug 11 16:47:43.247138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1025/1779] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:44.112274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:44.114453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:44.121115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:44.121607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:44.122043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:44.122731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:44.123180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:44.123601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:44.153012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-964e4add-8a52-4af4-bcd6-42ad2e920b45 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 11 16:47:44.153562 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 755/1780] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:44.269425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:44.270026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:44.276431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:44.276905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:44.277332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:44.278007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:44.278458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:44.278875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:44.339235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:44.347963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:44.349490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:44.350627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-295cb4dd-091b-4fdc-b147-57cfd6afff22 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085746 Aug 11 16:47:44.351180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1026/1781] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:45.165265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:45.167407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:45.174735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:45.175209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:45.175646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:45.176362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:45.176810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:45.177233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:45.206340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a2ccdd37-6fef-46bd-9035-ecd606b3c00a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 11 16:47:45.206883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 756/1782] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:45.373625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:45.374241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:45.380823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:45.381304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:45.381742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:45.382434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:45.382888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:45.383313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:45.444578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:45.452983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:45.455196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:45.456473 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7c8e423b-46ae-4769-aba2-536767409169 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086727 Aug 11 16:47:45.457033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1027/1783] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:46.218253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:46.221230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:46.227717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:46.228231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:46.228672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:46.229363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:46.229824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:46.230254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:46.258558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ebe2a6b3-1fa2-4983-8475-947a3a2c9286 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 11 16:47:46.259110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 757/1784] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:46.479506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:46.480048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:46.486718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:46.487199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:46.487632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:46.488354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:46.488807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:46.489266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:46.549594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:46.557962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:46.559469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:46.560714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e1cee25-ddb0-4fde-9f75-9debf395959e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085247 Aug 11 16:47:46.561269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1028/1785] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:47.270996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:47.273181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:47.279538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:47.280011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:47.280474 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:47.281151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:47.281596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:47.282015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:47.311234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8edd0b34-776a-482e-8d38-b97dc55ff455 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Aug 11 16:47:47.311708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 758/1786] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:47.584158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:47.584819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:47.587145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:47.592431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:47.592912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:47.593344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:47.594035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:47.594486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:47.595450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:47.660279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:47.668676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:47.670175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:47.671308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-877d41a3-a395-4a45-9f15-0260a880c669 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091297 Aug 11 16:47:47.671849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1029/1787] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:48.323912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:48.326060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:48.333003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:48.333482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:48.333915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:48.334611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:48.335063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:48.335492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:48.364966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-067c05e6-571e-4667-b88d-010306b1359d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Aug 11 16:47:48.365522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 759/1788] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:48.694006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:48.694538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:48.700932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:48.701435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:48.701868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:48.702579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:48.702998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:48.703416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:48.766338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:48.775346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:48.776883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:48.778016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1dba66a2-857d-4c1f-9302-1400e09420bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088030 Aug 11 16:47:48.778584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1030/1789] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:49.376832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:49.378982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:49.385472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:49.385954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:49.386396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:49.387089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:49.387546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:49.387973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:49.417982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9e5c12ac-67fc-4489-bf92-3b67bfd9190b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Aug 11 16:47:49.418535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 760/1790] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:49.800498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:49.801105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:49.807600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:49.808077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:49.808540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:49.809229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:49.809712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:49.810138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:49.871978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:49.881387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:49.882888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:49.884027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26d50352-fda4-4afe-a33e-a292631e6f70 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087837 Aug 11 16:47:49.884607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1031/1791] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:50.430292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:50.432457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:50.439380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:50.439886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:50.440344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:50.441393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:50.441840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:50.442258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:50.473346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b33b03b1-bb5d-4b08-9807-128ee0a2dd43 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Aug 11 16:47:50.474168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 761/1792] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:50.906476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:50.907086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:50.914426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:50.914906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:50.915342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:50.916033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:50.916513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:50.916938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:50.978265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:50.987185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:50.988724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:50.989858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46d2504e-622d-4f86-a601-f86cead511ca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087345 Aug 11 16:47:50.990407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1032/1793] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:47:51.487400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:51.489681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:51.496013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:51.496522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:51.496956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:51.497640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:51.498089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:51.498508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:51.502710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:51.527450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c764a3fd-6021-494d-8433-826660eb8de1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Aug 11 16:47:51.527998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 762/1794] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:52.012403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:52.013017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:52.020548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:52.021032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:52.021467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:52.022159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:52.022610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:52.023063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:52.087386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:52.096143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:52.097656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:52.098826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5008939f-edae-4a0a-93e3-45b92bb81bb8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090377 Aug 11 16:47:52.099390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1033/1795] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:52.539507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:52.541703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:52.548664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:52.549318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:52.549750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:52.550436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:52.550881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:52.551296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:52.580967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-19958eae-d9bb-4144-9d41-11e8632c4e15 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Aug 11 16:47:52.581510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 763/1796] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:53.122401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:53.123010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:53.130057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:53.130538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:53.130978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:53.131673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:53.132134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:53.132561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:53.197008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:53.205948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:53.207461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:53.208638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4e4c10d3-e987-4a0d-94e3-74aa8d1d78b0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090203 Aug 11 16:47:53.209190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1034/1797] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:53.593226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:53.595411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:53.602210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:53.602691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:53.603122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:53.603806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:53.604286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:53.604706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:53.634294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ee841790-5654-4d8c-989c-a9179dbae6a6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045111 Aug 11 16:47:53.634834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 764/1798] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:54.230891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:54.231496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:54.238718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:54.239202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:54.239638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:54.240356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:54.240806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:54.241223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:54.301058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:54.309290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:54.310723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:54.311842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-005fa29d-68d4-41db-9301-8023317e030f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084897 Aug 11 16:47:54.312688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1035/1799] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:54.646608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:54.648692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:54.655034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:54.655537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:54.655966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:54.656676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:54.657130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:54.657538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:54.686347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b26b87a5-89af-4e0d-828f-cb8e980a6447 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Aug 11 16:47:54.686886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 765/1800] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:55.335670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:55.336275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:55.342609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:55.343085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:55.343516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:55.344230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:55.345298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:55.345719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:55.409287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:55.417630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:55.419117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:55.420284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-352b39c5-d598-4668-8ddf-e4ab08362459 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088821 Aug 11 16:47:55.420833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1036/1801] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:55.698874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:55.701032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:55.703386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=58 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:55.709323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:55.709796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:55.710225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:55.710908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:55.711354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:55.711773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:55.740892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3bc3c049-6e77-4748-a250-d7d38a718bef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Aug 11 16:47:55.741445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 766/1802] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:56.443363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:56.443912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:56.450542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:56.451012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:56.451444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:56.452143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:56.452596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:56.453009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:56.517899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:56.526306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:56.527814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:56.528987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-723405fe-a520-423b-a232-991b4537369c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089580 Aug 11 16:47:56.529536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1037/1803] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:56.754064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:56.756162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:56.762523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:56.763004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:56.763440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:56.764159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:56.764615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:56.765041 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:56.794836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-963e7d96-a217-4d6c-901f-b256d68d8923 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Aug 11 16:47:56.795387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 767/1804] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:57.552137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:57.552948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:57.559648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:57.560158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:57.560596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:57.561277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:57.561724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:57.562142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:57.565251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:47:57.623909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:57.632498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:57.634057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:57.635187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b35281e-c092-4d82-b0b0-d51901fcd5f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087108 Aug 11 16:47:57.635727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1038/1805] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:57.807011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:57.809141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:57.816332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:57.816816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:57.817248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:57.817940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:57.818395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:57.818817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:57.848744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-733d7f6f-d9bf-4860-9943-767de304217e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Aug 11 16:47:57.849290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 768/1806] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:58.658728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:58.659325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:58.665618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:58.666093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:58.666521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:58.667474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:58.667924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:58.668371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:58.728582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:58.737106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:58.738661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:58.739817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-27298e50-01b0-4a61-8f71-0758ad3dc84f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085084 Aug 11 16:47:58.740426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1039/1807] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:47:58.861404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:58.863541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:58.869886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:58.870362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:58.870793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:58.871471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:58.871967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:58.872408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:58.901347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e15e3f2d-a6dc-422c-829c-d213e4001f8a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 11 16:47:58.901896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 769/1808] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:47:59.762736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:59.763349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:59.770547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:59.771041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:59.771485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:59.772214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:59.772672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:59.773099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:59.835562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:59.844042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:59.845610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:47:59.846740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32150baa-c8e4-4f0d-96dc-e8f44ca15c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087938 Aug 11 16:47:59.847297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1040/1809] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:47:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:47:59.913578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:47:59.915636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:47:59.922197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:59.923290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:59.923782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:59.924533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:47:59.924985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:47:59.925410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:47:59.954692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3cc87de8-bcd4-4da5-b604-c0d3ba2e47a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Aug 11 16:47:59.955243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 770/1810] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:47:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:00.870124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:00.870766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:00.877760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:00.878236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:00.878665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:00.879354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:00.879800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:00.880266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:00.943565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:00.951880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:00.953408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:00.955144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0dc77484-5274-4d35-96dd-e27361c8ab92 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088941 Aug 11 16:48:00.955697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1041/1811] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:00.967071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:00.969280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:00.976158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:00.976631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:00.977060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:00.977740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:00.978183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:00.978602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:01.007545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f038132a-2631-401f-b109-a8d0a981092f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Aug 11 16:48:01.008090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 771/1812] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:01.977586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:01.978157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:01.984718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:01.985702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:01.986324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:01.987049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:01.987510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:01.987936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:02.018970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:02.021309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:02.027272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:02.027757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:02.028221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:02.028921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:02.029373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:02.029826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:02.049417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:02.058622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:02.060172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:02.060325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41b5ed37-f575-4462-b5f1-dafad055d479 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 11 16:48:02.060741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 772/1813] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:02.061535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84fd820d-fa06-4479-bc71-787ec724c0e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087955 Aug 11 16:48:02.062166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1042/1814] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:03.073330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:03.075551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:03.082627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:03.083114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:03.083555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:03.084276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:03.084734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:03.085156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:03.086152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:03.086760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:03.093185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:03.093662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:03.094092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:03.094906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:03.095491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:03.095921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:03.115157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ed7d2958-bb27-43a0-bdae-5a5118076991 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Aug 11 16:48:03.115967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 773/1815] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:03.159585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:03.167852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:03.169382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:03.170496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-429fb9dc-b597-4032-822d-62a6afbfbfca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088487 Aug 11 16:48:03.171041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1043/1816] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:04.128145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:04.130422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:04.137038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:04.137507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:04.137937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:04.138615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:04.139063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:04.139475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:04.169032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bcda6ea4-3bcf-43d7-b2bf-a83d17497518 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 11 16:48:04.169598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 774/1817] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:04.194296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:04.194900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:04.201353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:04.201830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:04.202261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:04.202937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:04.203412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:04.203967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:04.264373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:04.273177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:04.274669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:04.275793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3e205197-c10c-4171-910a-fe1d6a7d8d69 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085426 Aug 11 16:48:04.276383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1044/1818] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:05.181348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:05.183470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:05.190720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:05.191179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:05.191606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:05.192315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:05.192760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:05.193176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:05.221669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5f19fb17-9a8e-49c3-abe2-a73ffcf67af7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Aug 11 16:48:05.222218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 775/1819] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:05.298792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:05.299437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:05.305869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:05.306346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:05.306830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:05.307455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:05.307898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:05.308347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:05.371467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:05.380871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:05.382381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:05.383569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-10db3d10-d555-4983-a8d8-981760f94bf4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088598 Aug 11 16:48:05.384143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1045/1820] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:06.234057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:06.236269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:06.243315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:06.243795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:06.244269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:06.244961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:06.245417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:06.245842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:06.274203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b6600dc0-be63-429f-9aac-837a9c7a06fc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 11 16:48:06.274756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 776/1821] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:06.406647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:06.407177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:06.413940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:06.414417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:06.414845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:06.415518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:06.415965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:06.416409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:06.477132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:06.485593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:06.487102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:06.488307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-618733a9-b77f-48aa-8edb-1cd76caadd0a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085552 Aug 11 16:48:06.488866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1046/1822] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:07.287826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:07.290097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:07.296602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:07.297080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:07.297513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:07.298197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:07.298653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:07.299538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:07.328223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e603a5c9-aaf5-41af-9d7d-46a267b0ecb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Aug 11 16:48:07.328714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 777/1823] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:07.510731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:07.511333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:07.518442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:07.519143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:07.519580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:07.520298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:07.520747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:07.521171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:07.583708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:07.592037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:07.593562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:07.594684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fb2c53b2-606d-4918-b1d3-822f4b35a51d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087820 Aug 11 16:48:07.595240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1047/1824] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:08.341342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:08.343408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:08.350149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:08.350635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:08.351087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:08.351766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:08.352240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:08.352665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:08.378090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:08.383209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c4786a85-d945-4995-9f35-ed6f9aeab363 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Aug 11 16:48:08.383761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 778/1825] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:08.617412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:08.617947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:08.624387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:08.624869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:08.625307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:08.625998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:08.626451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:08.626877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:08.686749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:08.696335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:08.697848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:08.698990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75335746-8ea2-4a50-8ba8-cf1d0644b970 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085594 Aug 11 16:48:08.699544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1048/1826] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:09.396189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:09.398322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:09.404935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:09.405424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:09.405866 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:09.406560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:09.407015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:09.407446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:09.436440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1fa634ac-c5da-43a8-9ad7-1bcf40101f1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 11 16:48:09.436990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 779/1827] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:09.720251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:09.720883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:09.727287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:09.727765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:09.728232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:09.728922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:09.729373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:09.729796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:09.795778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:09.804582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:09.806137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:09.807305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ea62fe85-6ed4-4a52-bf5a-85fefb0a3846 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090989 Aug 11 16:48:09.807860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1049/1828] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:10.448318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:10.450397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:10.457047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:10.457521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:10.457952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:10.458635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:10.459078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:10.459500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:10.492239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-00b9430b-3dda-4fd8-be64-f42073c37fcf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Aug 11 16:48:10.492950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 780/1829] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:10.831215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:10.831762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:10.838264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:10.838736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:10.839164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:10.839837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:10.840316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:10.840739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:10.900864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:10.909906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:10.911403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:10.912564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5117f00d-36f1-44ab-90a2-325e174ae43a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085818 Aug 11 16:48:10.913116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1050/1830] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:11.505347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:11.507498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:11.513945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:11.514436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:11.514842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:11.515517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:11.515961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:11.516409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:11.545249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a0db350-0a9b-4ccd-acf4-d1e04ffa2992 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Aug 11 16:48:11.545786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 781/1831] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:11.934682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:11.935284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:11.943293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:11.943772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:11.944233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:11.944915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:11.945357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:11.945771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:12.006037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:12.014258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:12.015767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:12.016920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c908bb98-f089-4489-8d76-22bc1f066ad1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086128 Aug 11 16:48:12.017469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1051/1832] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:12.558213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:12.560398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:12.567709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:12.568210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:12.568646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:12.569326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:12.569771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:12.570195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:12.598234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-00401e22-f8b7-43a2-8b2c-da2bb78f0097 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Aug 11 16:48:12.598806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 782/1833] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:13.039470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:13.040082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:13.046575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:13.047055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:13.047489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:13.048207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:13.048655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:13.049817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:13.110758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:13.119534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:13.121016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:13.122148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3ba1f188-34fb-4b6e-b24a-67f4cd898783 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086626 Aug 11 16:48:13.122691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1052/1834] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:13.609822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:13.611999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:13.618441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:13.618926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:13.619365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:13.620059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:13.620540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:13.620968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:13.650336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-edb6e3e2-c86a-4378-a7f4-2aaf2c434b36 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Aug 11 16:48:13.650882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 783/1835] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:14.144030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:14.144628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:14.151086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:14.151571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:14.152011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:14.152734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:14.153190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:14.153616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:14.217466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:14.226409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:14.227923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:14.229092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-caa34d2c-5271-4693-a113-bf7ce6034248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089465 Aug 11 16:48:14.229656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1053/1836] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:14.341106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:48:14.341296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:48:14.663371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:14.665576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:14.672079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:14.672581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:14.673013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:14.673858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:14.674350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:14.674847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:14.703860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-84e473a6-5ffb-499e-a7e7-807654e09d80 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Aug 11 16:48:14.704433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 784/1837] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:15.252478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:15.253092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:15.259405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:15.259879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:15.260348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:15.261020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:15.261472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:15.261887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:15.323879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:15.326116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:15.333966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:15.335479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:15.336674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc4ec701-99e0-4429-881a-b0ff9e962e3e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088751 Aug 11 16:48:15.337224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1054/1838] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:15.716854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:15.718975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:15.725927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:15.726396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:15.726824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:15.727500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:15.727944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:15.728392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:15.757372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2418f9df-163b-403f-8301-0aeeede0d23f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 11 16:48:15.757910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 785/1839] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:16.358472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:16.359014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:16.366019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:16.366504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:16.366939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:16.367621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:16.368071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:16.368518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:16.429752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:16.438385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:16.441072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:16.442215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3a7dc957-dd1a-4d79-803d-456f845ada81 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087811 Aug 11 16:48:16.442774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1055/1840] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:16.770008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:16.772055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:16.778472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:16.778945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:16.779375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:16.780058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:16.780528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:16.780949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:16.810818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a6a0a318-91a8-444b-bc94-1e8dff7d2c4b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Aug 11 16:48:16.811362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 786/1841] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:17.464669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:17.465221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:17.471707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:17.472207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:17.472638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:17.473314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:17.473766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:17.474199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:17.537006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:17.545420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:17.546925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:17.548067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0da19c4c-512a-4054-af8e-2fa0c834c248 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087430 Aug 11 16:48:17.549246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1056/1842] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:17.823236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:17.825468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:17.832081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:17.832583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:17.833014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:17.833717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:17.834159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:17.834576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:17.863475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f5b22eb-44d5-4c32-9110-48d32127fa2c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 11 16:48:17.864018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 787/1843] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:18.782570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:18.783202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:18.785112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:18.790546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:18.791032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:18.791470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:18.792190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:18.792646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:18.793078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:18.982975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:18.991542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:18.993064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:18.994193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-230e01fb-f094-4343-8794-5e080a72e6fc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.427026 Aug 11 16:48:18.994750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1057/1844] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:19.005250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:19.007390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:19.013603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:19.014086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:19.014523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:19.015234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:19.015677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:19.016128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:19.046558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e7e042c6-c736-4395-aaab-77798b2ee51b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174784 Aug 11 16:48:19.047135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 788/1845] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:20.017139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:20.018349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:20.024937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:20.025425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:20.025866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:20.026560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:20.027015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:20.027444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:20.059980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:20.062199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:20.069774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:20.070266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:20.070706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:20.071413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:20.071869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:20.072341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:20.088845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:20.098680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:20.100226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:20.101367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-64fc1962-9fab-4fb7-9ee8-b758633a71ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088216 Aug 11 16:48:20.101924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1058/1846] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:20.103331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a7e1c13-8ada-4b25-a8ef-630050f01388 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Aug 11 16:48:20.103885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 789/1847] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:21.116470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:21.118840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:21.123206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:21.123804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:21.125493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:21.125975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:21.126411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:21.127501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:21.128245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:21.128679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:21.130256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:21.130729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:21.131167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:21.131853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:21.132335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:21.132750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:21.158482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f017dd94-8d56-457b-97e4-e83c388411bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Aug 11 16:48:21.159684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1059/1848] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:21.197550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:21.206628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:21.208160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:21.209308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7a7838ed-f4f5-4358-ba29-263cc1331225 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090036 Aug 11 16:48:21.209867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 790/1849] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:22.171676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:22.173920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:22.180343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:22.180820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:22.181247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:22.181925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:22.182370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:22.182785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:22.211984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e3e2045-7234-49e0-8cb1-e9f872eabc21 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 11 16:48:22.212560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1060/1850] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:22 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:22.235564 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:22.236615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:22.243026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:22.243497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:22.243925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:22.244632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:22.245076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:22.245490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:22.305905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:22.314570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:22.316139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:22.317279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0facdca-3294-422c-8eb6-41dcc7e9afaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085579 Aug 11 16:48:22.317830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 791/1851] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:23.223920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:23.226237 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:23.232638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:23.233113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:23.233544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:23.234215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:23.234662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:23.235078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:23.263746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e819a7c-e71b-4220-bdf0-4b90266ab205 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 11 16:48:23.264382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1061/1852] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:23.339964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:23.340513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:23.347693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:23.348205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:23.348630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:23.349315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:23.349766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:23.350189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:23.411420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:23.420056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:23.421585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:23.422730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fe6a83c7-d4ca-4c42-9dd2-cf5eaabc039c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086735 Aug 11 16:48:23.423289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 792/1853] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:24.276465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:24.278644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:24.285716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:24.286186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:24.286620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:24.287299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:24.287749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:24.288268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:24.317332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aec91e62-6122-4907-bf39-2d7d7676b6aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Aug 11 16:48:24.317802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1062/1854] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:24.446376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:24.447050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:24.453439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:24.453945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:24.454375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:24.455669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:24.456154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:24.456582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:24.519655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:24.528209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:24.529703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:24.530841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-55608ca3-d7f7-4e75-a6d1-0add3bfa1b12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088440 Aug 11 16:48:24.531393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 793/1855] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:25.331771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:25.333934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:25.340359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:25.340834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:25.341264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:25.341942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:25.342717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:25.343139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:25.372288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ccc147fe-15de-4229-94c9-37b664c47449 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045266 Aug 11 16:48:25.372827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1063/1856] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:25.554351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:25.554989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:25.561483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:25.561962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:25.562653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:25.563347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:25.563794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:25.564733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:25.624009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:25.632982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:25.634477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:25.635607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0a41026b-fdac-4087-a254-8e96ef09ccb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085198 Aug 11 16:48:25.636306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 794/1857] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:26.384927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:26.387025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:26.394130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:26.394615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:26.395056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:26.395746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:26.396243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:26.396671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:26.425528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-273598e2-1eb1-4e94-b04b-e965831bbc3b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Aug 11 16:48:26.426081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1064/1858] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:26.659028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:26.659685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:26.662104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=58 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:26.667393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:26.667864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:26.668333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:26.669015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:26.669458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:26.669873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:26.684836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:26.731214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:26.740326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:26.741813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:26.742950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8722467e-e33d-4348-b102-2710f4bc6c0b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088097 Aug 11 16:48:26.743503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 795/1859] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:27.437168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:27.439815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:27.446211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:27.446691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:27.447127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:27.447811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:27.448291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:27.448718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:27.480131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2c9bb013-a761-41d6-b9e7-485f8e1be42c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Aug 11 16:48:27.480701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1065/1860] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:27.765159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:27.765762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:27.772811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:27.773287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:27.773718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:27.774400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:27.774844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:27.775265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:27.865269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:27.873966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:27.875470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:27.876669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5facb8b1-2da3-4dc7-b360-6a49c4a9ef6e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.115428 Aug 11 16:48:27.877231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 796/1861] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:28.493428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:28.495605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:28.501928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:28.502409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:28.502872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:28.503561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:28.504005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:28.504447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:28.536384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-da38c258-3ab2-4999-9a33-b56df9b12045 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Aug 11 16:48:28.536953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1066/1862] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:28.901056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:28.901915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:28.909928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:28.910522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:28.911299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:28.912132 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:28.912589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:28.913013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:28.987493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:28.996713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:28.998219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:28.999365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-daec032c-40b7-48a7-abf4-f439ae4a372b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.102972 Aug 11 16:48:28.999919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 797/1863] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:29.548617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:29.551383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:29.557816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:29.558301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:29.558738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:29.559424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:29.559880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:29.560334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:29.589713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-310039b5-59ca-4b93-b134-867f2efc33fb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 11 16:48:29.590263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1067/1864] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:30.023199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:30.023816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:30.030342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:30.030820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:30.031255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:30.031943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:30.032431 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:30.032856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:30.094610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:30.103733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:30.105263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:30.106409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a4f738e8-c7c3-4a42-aaba-e283f479a6f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087277 Aug 11 16:48:30.106971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 798/1865] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:30.601901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:30.604054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:30.610432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:30.610906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:30.611336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:30.612033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:30.613019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:30.613452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:30.642000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0477e06-dfcb-4a9f-9113-3cedf74485b7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 11 16:48:30.642543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1068/1866] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:31.130482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:31.131095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:31.138345 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:31.138821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:31.139250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:31.139927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:31.140402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:31.140818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:31.202325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:31.210662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:31.212246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:31.213390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-35a17955-493d-445d-b758-e4eccce259a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087968 Aug 11 16:48:31.213935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 799/1867] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:31.654188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:31.656350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:31.663481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:31.663954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:31.664409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:31.665080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:31.665525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:31.665937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:31.696022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbd089b1-ce9d-49dd-9251-fee251fa2c52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045514 Aug 11 16:48:31.696603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1069/1868] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:32.234870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:32.235475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:32.242224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:32.242700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:32.243131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:32.243817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:32.244292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:32.244714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:32.307674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:32.316336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:32.317847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:32.318981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6b065c09-a9bc-44ab-908a-430ed6d9d49a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088084 Aug 11 16:48:32.319534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 800/1869] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:32.644765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:48:32.644978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:48:32.708801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:32.710997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:32.717439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:32.717914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:32.718343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:32.719019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:32.719463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:32.719882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:32.748819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0162e810-5e54-4fe6-b409-4f5f1442f7f8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Aug 11 16:48:32.749362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1070/1870] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:33.341514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:33.342049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:33.348682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:33.349159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:33.349586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:33.350264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:33.350710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:33.351128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:33.411530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:33.420083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:33.421600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:33.422724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e12a852-abe2-488e-8dd0-414b20a2a68c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085240 Aug 11 16:48:33.423266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 801/1871] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:33.761257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:33.763450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:33.770353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:33.770830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:33.771261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:33.771969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:33.772451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:33.772869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:33.787005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:33.802931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e02de62b-a8fd-4c0d-ae05-9a8adbfc8493 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Aug 11 16:48:33.803478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1071/1872] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:34.446367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:34.446893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:34.453375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:34.453853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:34.454286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:34.454973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:34.455423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:34.455844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:34.516361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:34.525817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:34.527481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:34.528505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fb5f2423-f982-4ef8-89fd-0ab04e5acdaf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086208 Aug 11 16:48:34.529059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 802/1873] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:34.815214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:34.818230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:34.824591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:34.825067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:34.825495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:34.826171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:34.826616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:34.827316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:34.855681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-727305ff-2bb1-43e1-bebb-d6f93bf1ed1a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 11 16:48:34.856247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1072/1874] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:35.550829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:35.551446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:35.557942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:35.558425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:35.558863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:35.559555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:35.560010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:35.560465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:35.623193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:35.631617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:35.633168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:35.634309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9f63ed28-1a3b-4625-97fb-4ec4081c26fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087724 Aug 11 16:48:35.634875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 803/1875] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:35.867872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:35.870046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:35.876468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:35.876941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:35.877369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:35.878166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:35.878620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:35.879037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:35.907488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-83a4be08-6021-4308-9732-37dab4335b20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Aug 11 16:48:35.908028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1073/1876] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:36.657008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:36.657615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:36.664913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:36.665393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:36.665835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:36.666524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:36.666979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:36.667407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:36.731465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:36.740618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:36.742130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:36.743280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0aa68098-ae23-4a2a-acc4-18bc9e09144f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090177 Aug 11 16:48:36.743837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 804/1877] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:36.920276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:36.922342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:36.929455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:36.929931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:36.930357 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:36.931034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:36.931477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:36.931891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:36.960459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc617f56-ffa3-463d-9932-21764fe31145 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Aug 11 16:48:36.960992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1074/1878] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:37.765878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:37.766483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:37.773803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:37.774282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:37.774714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:37.775394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:37.775840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:37.776292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:37.837960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:37.846361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:37.849010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:37.850154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-875b429c-f262-405b-b25d-e4df16ce8f97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088176 Aug 11 16:48:37.850711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 805/1879] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:37.972690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:37.974772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:37.981904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:37.982379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:37.982807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:37.983480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:37.983923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:37.984430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:38.012653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b30c445-a992-4136-ba82-fdb5defa50fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 11 16:48:38.013190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1075/1880] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:38.872932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:38.873591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:38.881035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:38.881510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:38.881946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:38.882628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:38.883077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:38.883498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:38.944757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:38.953116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:38.954620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:38.955759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ded6736a-aca0-4d93-b8b0-34bc4277bfe9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086799 Aug 11 16:48:38.956638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 806/1881] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:39.024993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:39.027150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:39.033507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:39.034490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:39.034924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:39.035707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:39.036192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:39.036623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:39.069648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66444f34-ddd4-4e50-b7a8-6414e50e0ba2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048436 Aug 11 16:48:39.070256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1076/1882] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:39.978538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:39.979073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:39.985544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:39.986018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:39.986447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:39.987154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:39.987701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:39.988151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:40.050320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:40.059017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:40.060534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:40.061675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5266d639-6d76-4b71-9eeb-052485773a0e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087138 Aug 11 16:48:40.062232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 807/1883] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:40.082352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:40.084554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:40.091027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:40.091514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:40.091953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:40.092684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:40.093143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:40.093570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:40.122562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-838f8581-ccdb-4e3d-be24-68ba078491b6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 11 16:48:40.123106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1077/1884] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:41.085835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:41.086437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:41.092880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:41.093348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:41.093770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:41.094444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:41.094889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:41.095303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:41.134712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:41.136891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:41.143919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:41.144431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:41.144867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:41.145561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:41.146011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:41.146431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:41.160258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:41.168751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:41.170267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:41.171420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c415832f-3def-49c7-ae13-f5362ce586a6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089647 Aug 11 16:48:41.171983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 808/1885] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:41.177246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ce2c88d8-4d29-47fb-8ca6-4c7e7aff1b12 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Aug 11 16:48:41.177812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1078/1886] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:48:42.189615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:42.191826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:42.193643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:42.194249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:42.198301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:42.198784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:42.199219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:42.199901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:42.200373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:42.200791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:42.200897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:42.201332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:42.201760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:42.202434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:42.202878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:42.203297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:42.229562 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3ed6d255-f2c0-4e0e-9bb4-fa3b8d387b27 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Aug 11 16:48:42.230321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 809/1887] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:42.265645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:42.274793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:42.276318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:42.277450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bc31f767-ff32-45ea-b94f-25e9090c712d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087706 Aug 11 16:48:42.277997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1079/1888] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:43.042846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:48:43.043098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:48:43.242001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:43.244305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:43.250781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:43.251261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:43.251695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:43.252416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:43.253464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:43.253891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:43.284513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e86ed9ba-fea2-433b-b3dd-d2cd804c4a24 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 Aug 11 16:48:43.285063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 810/1889] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:43.301200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:43.301809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:43.308225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:43.308710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:43.309176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:43.309866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:43.310322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:43.310861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:43.371601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:43.380614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:43.382121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:43.383281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a5b904d-5c52-4d14-b4c5-d4224012462b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086611 Aug 11 16:48:43.383834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1080/1890] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:44.296717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:44.298850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:44.306082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:44.306607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:44.306999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:44.307692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:44.308169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:44.308595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:44.338009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2fc6ddb8-92db-4298-b66e-60b620e19fe0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Aug 11 16:48:44.338559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 811/1891] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:44.405147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:44.405752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:44.412712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:44.413183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:44.413611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:44.414286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:44.414732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:44.415149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:44.478949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:44.488154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:44.489660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:44.490785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fe42a879-0ba6-4818-b233-38073107b325 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089580 Aug 11 16:48:44.491336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1081/1892] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:48:45.351050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:45.353198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:45.360601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:45.361092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:45.361532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:45.362226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:45.362890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:45.363315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:45.366022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:45.393843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4cbbc9bd-84ff-4ff2-a0ad-851fc1ac67dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047039 Aug 11 16:48:45.394391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 812/1893] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:45.512219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:45.512823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:45.519885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:45.520403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:45.520836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:45.521542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:45.521991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:45.522412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:45.583980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:45.592313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:45.593811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:45.594929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28620d58-16d3-4d4d-a705-bad56817ae5e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086609 Aug 11 16:48:45.595475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1082/1894] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:46.406180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:46.408252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:46.415252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:46.415722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:46.416265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:46.416947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:46.417390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:46.417807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:46.446772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-acb0524d-531b-4ec4-a4bb-9d567eb98230 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Aug 11 16:48:46.447317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 813/1895] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:46.618133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:46.618743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:46.624726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:46.625202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:46.625628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:46.626304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:46.626748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:46.627166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:46.687796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:46.696894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:46.698392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:46.699519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e8d8d04f-03f6-42e7-a07f-d30cc189ec8e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085465 Aug 11 16:48:46.700069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1083/1896] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:47.460037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:47.462099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:47.468668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:47.469143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:47.469573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:47.470262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:47.470707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:47.471127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:47.500314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a223de1-13c6-4dac-80a0-d6fa456a21ec tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 11 16:48:47.500858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 814/1897] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:47.723817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:47.724394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:47.730845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:47.731323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:47.731755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:47.732472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:47.732923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:47.733343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:47.796284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:47.805288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:47.806783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:47.807906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59efcfef-5d86-4e9e-81fd-f143cceb4d67 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088729 Aug 11 16:48:47.808484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1084/1898] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:48.513245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:48.515297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:48.521825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:48.522297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:48.522728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:48.523404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:48.523841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:48.524288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:48.552884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-05093ac4-06da-468f-b914-da8cf63b394a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 11 16:48:48.553426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 815/1899] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:48.831379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:48.831995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:48.834432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:48.839892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:48.840406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:48.840844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:48.841573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:48.842102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:48.842548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:48.911817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:48.921204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:48.922714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:48.923859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a10f805e-4ae2-47fb-9d53-dfcaecb55c39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.096349 Aug 11 16:48:48.924447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1085/1900] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:49.564923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:49.567623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:49.574449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:49.574928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:49.575363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:49.576047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:49.576523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:49.576946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:49.605953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4e6ba917-6cfb-4ae4-9a67-7cac0afa3c11 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Aug 11 16:48:49.606509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 816/1901] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:49.953653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:49.954265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:49.960786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:49.961264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:49.961695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:49.962601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:49.963072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:49.963504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:50.024641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:50.032989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:50.034500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:50.036430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-eeb94c62-98b5-4ad2-993e-32c56197b187 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086496 Aug 11 16:48:50.037070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1086/1902] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:50.618078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:50.620309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:50.626721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:50.627198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:50.627632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:50.628358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:50.628916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:50.630209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:50.658754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a6819faa-9b24-422b-9817-0440fcf8cf70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Aug 11 16:48:50.659306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 817/1903] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:51.058729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:51.059337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:51.066070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:51.067073 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:51.067506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:51.068241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:51.068687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:51.069103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:51.130884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:51.139718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:51.141255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:51.142382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-090e7c4e-b8a9-47ef-870c-69c00eb313f3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087548 Aug 11 16:48:51.142940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1087/1904] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:51.671617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:51.673776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:51.680316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:51.680799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:51.681238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:51.681934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:51.682388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:51.682813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:51.713891 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-48b62722-d167-42be-9e7d-8ada7cd004f9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Aug 11 16:48:51.714451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 818/1905] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:52.164620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:52.165259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:52.171688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:52.172203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:52.172639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:52.173329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:52.173783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:52.174211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:52.178825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:52.235541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:52.244575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:52.246098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:52.247241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-525873bf-25a8-4415-90b8-9e69f110bd91 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086526 Aug 11 16:48:52.247800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1088/1906] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:52.726815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:52.729000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:52.735471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:52.735950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:52.736494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:52.737181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:52.737628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:52.738598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:52.767843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e861f3f3-b64a-497c-b3b2-2669bd3be8e6 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045576 Aug 11 16:48:52.768410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 819/1907] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:53.270948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:53.271556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:53.278055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:53.278532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:53.278965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:53.279650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:53.280131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:53.280548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:53.343829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:53.352310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:53.353827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:53.354955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-db8d522f-150a-48e4-8dc9-78c39cecb4ec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088535 Aug 11 16:48:53.355506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1089/1908] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:53.780303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:53.782450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:53.789547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:53.790017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:53.790445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:53.791121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:53.791563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:53.791980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:53.820600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1d25a240-953d-471a-ae96-bb7193d3401d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Aug 11 16:48:53.821144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 820/1909] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:54.377242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:54.377815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:54.384816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:54.385301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:54.385740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:54.386430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:54.386888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:54.387316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:54.447665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:54.456015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:54.457564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:54.459217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ae0d89ad-130f-4bbe-ab6d-c4c35fd26492 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085999 Aug 11 16:48:54.459775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1090/1910] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:54.833001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:54.835838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:54.842304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:54.842789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:54.843225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:54.843914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:54.844400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:54.844831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:54.873016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f8f5350b-4d7e-40aa-a711-e9893ff0c56d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 11 16:48:54.873578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 821/1911] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:55.482849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:55.483403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:55.489794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:55.490265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:55.490693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:55.491367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:55.491845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:55.492291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:55.554327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:55.562573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:55.564343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:55.565469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-55b22777-a8a4-45c5-892c-498a8f111e19 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086662 Aug 11 16:48:55.566018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1091/1912] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:55.885968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:55.888174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:55.894531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:55.895002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:55.895434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:55.896260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:55.896700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:55.897119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:55.926550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0aff461-b3a6-4171-bc4a-2f283d2d13d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Aug 11 16:48:55.927718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 822/1913] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:56.588697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:56.589281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:56.595620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:56.596122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:56.596549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:56.597227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:56.597675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:56.598092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:56.660479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:56.669296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:56.670809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:56.671945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f64824cc-2f5e-442d-b846-ef5a3a48506f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087137 Aug 11 16:48:56.672523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1092/1914] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:56.939769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:56.941860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:56.944275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:48:56.949605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:56.950106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:56.950538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:56.951248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:56.951687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:56.952124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:56.980993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ea3d1fc8-8e98-4c6e-9485-1a698c7bbe44 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Aug 11 16:48:56.981535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 823/1915] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:57.695711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:57.696361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:57.702888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:57.703369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:57.703802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:57.704550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:57.705005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:57.705429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:57.768500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:57.777647 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:57.779162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:57.780340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3309aeb3-b3f2-4042-b866-fb6fdb4f233e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089016 Aug 11 16:48:57.780892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1093/1916] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:57.993925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:57.995993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:58.002408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:58.002878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:58.003306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:58.003984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:58.004455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:58.004929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:58.033477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-32209ceb-d749-4401-b316-0a0ce1085994 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 11 16:48:58.034015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 824/1917] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:58.803905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:58.804570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:58.810731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:58.811211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:58.811649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:58.812375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:58.813095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:58.813519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:58.873166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:58.882573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:58.884062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:58.885209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bd884128-7114-4666-913c-bc8153d624b3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085957 Aug 11 16:48:58.885756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1094/1918] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:48:59.045470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:59.047586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:59.054671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:59.055093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:59.055547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:59.056237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:59.056680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:59.057134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:59.089890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d108b0a9-0302-40d8-8744-dbb107e3a657 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048316 Aug 11 16:48:59.090466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 825/1919] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:48:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:48:59.908528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:48:59.909133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:48:59.915795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:59.916313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:59.916742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:59.917416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:48:59.917859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:48:59.918272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:48:59.979063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:59.987366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:59.988899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:48:59.990272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f01fdef-1772-44cd-beab-e5adc5e3a7b6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085641 Aug 11 16:48:59.990811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1095/1920] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:48:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:00.102889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:00.107168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:00.113810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:00.114954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:00.115346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:00.116033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:00.116504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:00.116922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:00.145125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-955b826e-8c08-4caf-9368-62d0a730e114 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047233 Aug 11 16:49:00.145854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 826/1921] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:01.012459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:01.013050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:01.019513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:01.019991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:01.020453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:01.021144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:01.021594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:01.022014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:01.082303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:01.090708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:01.092309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:01.093444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ddd85f96-0a2f-41f9-8aa5-e85ac1445ed2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084892 Aug 11 16:49:01.093998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1096/1922] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:01.157595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:01.159746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:01.166552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:01.167033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:01.167473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:01.168188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:01.168645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:01.169071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:01.198556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-420d35cf-e3f5-49ea-9d4f-44110d2d42e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 11 16:49:01.199103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 827/1923] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:02.114996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:02.115595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:02.122011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:02.122487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:02.122916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:02.123593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:02.124038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:02.124477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:02.186464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:02.195565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:02.197089 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:02.198331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3835eb3b-4e4b-46c2-818c-6bd596e8c3aa tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087472 Aug 11 16:49:02.198878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1097/1924] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:02.211228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:02.213370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:02.219268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:02.219736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:02.220185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:02.220863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:02.221305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:02.221722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:02.246238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:02.251090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8b950e57-2926-4252-9e25-f8cc3eb4f55c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Aug 11 16:49:02.251642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 828/1925] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:03.220820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:03.221433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:03.227956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:03.228465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:03.228903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:03.229588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:03.230045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:03.230472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:03.264044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:03.266256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:03.273910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:03.274393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:03.274828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:03.275522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:03.275974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:03.276429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:03.295788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:03.304621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:03.306116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:03.306872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0c2c574-3612-4199-a01a-f427da9a7407 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 Aug 11 16:49:03.307302 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ed972612-82d9-42d2-b893-bff9358d4f90 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090331 Aug 11 16:49:03.308196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 829/1926] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:49:03.308351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1098/1927] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:04.319897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:04.322067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:04.328593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:04.329078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:04.329514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:04.330023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:04.330442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:04.330648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:04.330790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:04.331065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:04.337382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:04.337859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:04.338290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:04.338971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:04.339419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:04.339839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:04.361011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c3295f1f-45f4-49a7-9447-a33fb207e13e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Aug 11 16:49:04.361527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 830/1928] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:04.400693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:04.409155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:04.410664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:04.412336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b3015a7-f6b0-418e-be6a-32e890f17a05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086242 Aug 11 16:49:04.412885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1099/1929] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:05.373339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:05.375396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:05.381982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:05.382495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:05.382931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:05.383623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:05.384074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:05.384529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:05.413352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ef38405d-d7d7-4577-bddb-1e3311c91561 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 11 16:49:05.413902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 831/1930] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:05.434664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:05.435269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:05.441963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:05.442438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:05.442939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:05.443802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:05.444275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:05.444714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:05.504943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:05.514020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:05.515530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:05.516697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8012600e-9fd2-49c8-b573-3041ebe201c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085919 Aug 11 16:49:05.517288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1100/1931] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:06.425644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:06.428656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:06.435113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:06.435588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:06.436024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:06.436749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:06.437202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:06.437628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:06.467607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e96b3e87-e181-478a-aa00-c2716abc5558 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 11 16:49:06.468292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 832/1932] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:06.538684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:06.539287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:06.545743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:06.546216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:06.546674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:06.547349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:06.547791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:06.548231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:06.611439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:06.621016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:06.622505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:06.623703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e3ba8a4a-effb-441c-a2fa-0bd52bdc91e1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088968 Aug 11 16:49:06.624355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1101/1933] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:07.479671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:07.481809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:07.488332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:07.488814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:07.489256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:07.490693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:07.491151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:07.491579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:07.520122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b0538a0f-d452-49e2-95fc-9c302b6d537f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Aug 11 16:49:07.520715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 833/1934] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:07.647205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:07.647805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:07.654338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:07.654815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:07.655242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:07.655914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:07.656385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:07.656803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:07.717348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:07.725786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:07.727289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:07.728454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7de525f6-988a-478c-8f35-47ba855434d5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085954 Aug 11 16:49:07.729011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1102/1935] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:08.532768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:08.534818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:08.541822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:08.542300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:08.542733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:08.543416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:08.543867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:08.544314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:08.574907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-59711273-0f81-45e0-b6c9-5ac08850c279 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Aug 11 16:49:08.575462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 834/1936] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:08.750722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:08.751330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:08.758435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:08.758918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:08.759353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:08.760030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:08.760516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:08.760938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:08.821886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:08.830219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:08.831716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:08.832877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef450d6f-0854-48ad-9163-f54124fe22db tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086047 Aug 11 16:49:08.834275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1103/1937] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:09.588365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:09.590533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:09.596941 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:09.597417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:09.597843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:09.598527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:09.598964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:09.599376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:09.628251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cabe5a6a-d348-41cf-ac97-40ef2fe2e549 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 11 16:49:09.628797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 835/1938] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:09.856215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:09.856713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:09.863026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:09.863500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:09.863928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:09.864684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:09.865128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:09.865544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:09.928459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:09.930621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:09.938673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:09.940259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:09.941410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-01fd2c2f-8e6a-4b59-a35b-914d56958383 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089244 Aug 11 16:49:09.941961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1104/1939] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:10.640798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:10.642948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:10.649506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:10.649983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:10.650412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:10.651098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:10.651544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:10.651964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:10.681662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cb8df2ae-10b7-44f9-a095-4aaad9de8a77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Aug 11 16:49:10.682219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 836/1940] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:10.965722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:10.966241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:10.972934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:10.973417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:10.974413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:10.975096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:10.975542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:10.975961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:11.040484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:11.048919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:11.050413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:11.051583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-11bc986f-e301-405e-9c1d-af9bc0f1f9c3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089840 Aug 11 16:49:11.052195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1105/1941] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:11.695007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:11.697190 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:11.703264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:11.703733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:11.704184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:11.704865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:11.705304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:11.705742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:11.734729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bfa8be50-fe4d-4fec-9498-b6fbc1ca9134 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 11 16:49:11.735273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 837/1942] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 16:49:12.074860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:12.075492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:12.081986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:12.082467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:12.082904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:12.084071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:12.084549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:12.084978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:12.146147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:12.154510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:12.156015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:12.157181 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f2400d59-dc0d-4912-870a-d0207e79baca tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086344 Aug 11 16:49:12.157734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1106/1943] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:12.746904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:12.749046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:12.755647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:12.756141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:12.756575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:12.757255 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:12.757698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:12.758114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:12.787671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5a83e5a6-51cd-45d0-a1bf-968d6b8f1465 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 11 16:49:12.788375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 838/1944] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:13.179400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:13.180002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:13.186440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:13.186913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:13.187340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:13.188294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:13.188738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:13.189154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:13.249537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:13.258449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:13.259936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:13.261096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-baf85b07-42f5-41b5-8649-8ce37a9f21ef tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086267 Aug 11 16:49:13.261639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1107/1945] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:13.800701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:13.803560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:13.809961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:13.810435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:13.810862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:13.811537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:13.811978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:13.812422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:13.841722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ce23e71c-bdcc-4256-8303-dae32ba21885 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Aug 11 16:49:13.842274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 839/1946] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:14.283817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:14.284478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:14.291625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:14.292118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:14.292553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:14.293228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:14.293674 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:14.294093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:14.354776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:14.363173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:14.364762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:14.365935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-83f5a4f5-5411-4f86-82eb-abcae9b70243 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086033 Aug 11 16:49:14.366490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1108/1947] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:14.854689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:14.856852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:14.862705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:14.863176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:14.863606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:14.864313 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:14.864757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:14.865179 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:14.894109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e639c623-e865-40fc-a2e9-598c3a483b4d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Aug 11 16:49:14.894649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 840/1948] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:15.388738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:15.389461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:15.395927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:15.396593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:15.397395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:15.398079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:15.398527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:15.398967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:15.461800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:15.470151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:15.471645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:15.472805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a785b308-4dff-4201-afe4-1d9d7f465c9c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087944 Aug 11 16:49:15.473350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1109/1949] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:15.906900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:15.909053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:15.915889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:15.916393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:15.916824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:15.917500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:15.917943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:15.918362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:15.947489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fce1ab20-39e4-4ffc-8e7f-d38fabd07441 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 11 16:49:15.948086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 841/1950] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:16.494864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:16.495471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:16.501964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:16.502445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:16.502880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:16.503563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:16.504019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:16.504472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:16.564904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:16.574157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:16.575678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:16.576856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-36b627f0-e7c2-4c9a-bf97-e41c1f83895d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085984 Aug 11 16:49:16.577405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1110/1951] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:16.958936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:16.961279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:16.967628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:16.968111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:16.968572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:16.969233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:16.969678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:16.970094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:16.998415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6a47a93f-3764-4626-ab6e-fb34ac04dee4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Aug 11 16:49:16.998954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 842/1952] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:17.599742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:17.601061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:17.607671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:17.608199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:17.608642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:17.609333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:17.609790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:17.610216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:17.672407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:17.681137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:17.682645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:17.683819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b982d48f-2f5b-423d-af0b-a0052003af89 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088116 Aug 11 16:49:17.684410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1111/1953] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:18.011768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:18.013853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:18.020275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:18.020756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:18.021188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:18.022484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:18.023042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:18.023461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:18.051801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-710231f8-d521-49e8-9b74-616684e9236d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Aug 11 16:49:18.052386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 843/1954] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:18.706307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:18.706939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:18.713459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:18.713933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:18.714362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:18.715036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:18.715481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:18.715897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:18.776274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:18.784583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:18.786112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:18.787773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-631e3a9f-bea2-4e16-a4e0-ecab980b7898 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084801 Aug 11 16:49:18.788354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1112/1955] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:19.065213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:19.067350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:19.073856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:19.074336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:19.074773 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:19.075462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:19.075913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:19.076370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:19.106871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-53a94f6d-d7be-4453-b856-70add47c43da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Aug 11 16:49:19.107441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 844/1956] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 16:49:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:49:19.809824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:19.811106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:19.814964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:19.819017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:19.819497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:19.819958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:19.820708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:19.821156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:19.821578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:19.885227 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:19.893524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:19.895014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:19.896170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-86081de6-9dfa-479b-9748-4dbe67fa98fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090265 Aug 11 16:49:19.896724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1113/1957] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:20.119719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:49:20.121920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:20.128443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:20.128918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:20.129352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:20.130036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:20.130483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:20.130903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:20.145436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:20.224636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc04b6ed-01b9-4fca-9d3c-c6dfff95a785 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action" status: 200 len: 118768 microversion: 2.1 time: 0.109291 Aug 11 16:49:20.225304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 845/1958] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 16:49:20 2022] POST /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6/action => generated 118768 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:20.918696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:20.919307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:20.925742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:20.926223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:20.926655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:20.927336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:20.927785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:20.928236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:20.989764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:20.998228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:20.999724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:21.000891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-21bb1553-2617-4da5-9252-95f83e2ddee2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086094 Aug 11 16:49:21.001441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1114/1959] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:22.025026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:22.025640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:22.033048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.033522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.033952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.034633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.035077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.035494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.098215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:22.107453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:22.108983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:22.110121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-28bf879b-5116-44ac-9400-7027e06eb8f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090258 Aug 11 16:49:22.110672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 846/1960] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:22.637056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:22.637565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:22.644262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.644766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.645199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.645888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.646335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.646758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.672330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:49:22.748848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29dad592-940c-49de-a204-7dffb7f5ef97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 204 len: 0 microversion: 2.1 time: 0.116418 Aug 11 16:49:22.749425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1115/1961] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 16:49:22 2022] DELETE /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 16:49:22.759043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:22.759662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:22.766170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.766653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.767092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.767783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:22.768306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:22.768737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:22.904266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:22.912268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-80690186-9843-4a7b-8b9d-817f8489134d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.157820 Aug 11 16:49:22.912835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 847/1962] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:23.132837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:23.133525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:23.139441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:23.139915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:23.140375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:23.141048 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:23.141490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:23.141906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:23.204413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:23.213182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:23.214685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:23.215834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-42993859-b780-46a9-a344-398bf23574e8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087343 Aug 11 16:49:23.216426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1116/1963] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:23.933321 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:23.933927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:23.940756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:23.941224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:23.941650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:23.942327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:23.942772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:23.943190 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:24.073576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:24.081629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-38435668-7640-462a-a231-d6cd637623df tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152227 Aug 11 16:49:24.082183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 848/1964] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:23 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:24.238638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:24.239238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:24.246223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:24.246697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:24.247128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:24.247802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:24.248276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:24.248694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:24.311263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:24.320039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:24.321564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:24.322689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b8a3c900-d3e7-4ba3-bee3-7612b17683fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087926 Aug 11 16:49:24.323234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1117/1965] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:25.103340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:25.103956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:25.110383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:25.110853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:25.111289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:25.111968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:25.112435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:25.112851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:25.239640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:25.248761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-332a64a7-77cb-4b77-a298-501a14136cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149575 Aug 11 16:49:25.249323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 849/1966] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:25.345172 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:25.345694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:25.352875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:25.353356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:25.353791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:25.354477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:25.354915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:25.355335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:25.424370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:25.433309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:25.434803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:25.435925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef236bd8-797c-481d-8b42-5eb624f85e98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.094680 Aug 11 16:49:25.436503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1118/1967] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:26.270756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:26.271365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:26.278458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:26.278935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:26.279366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:26.280051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:26.280526 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:26.280946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:26.411912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:26.420011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff904446-3ece-4933-a8fc-e5ed816092c6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153136 Aug 11 16:49:26.420606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 850/1968] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:26.458247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:26.458857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:26.465328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:26.465813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:26.466249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:26.466937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:26.467393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:26.467816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:26.528698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:26.530968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:26.538445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:26.539962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:26.541125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-24b7db47-22ff-43f1-b0fa-2315e0b8eee5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086802 Aug 11 16:49:26.541677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1119/1969] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:27.442034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:27.442700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:27.445653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:27.451129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:27.451616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:27.452051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:27.452772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:27.453222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:27.453647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:27.565311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:27.565926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:27.574472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:27.574960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:27.575394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:27.576087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:27.576561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:27.576983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:27.587787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:27.595843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1231e311-2c6e-441c-9af9-f3ea51de6a30 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.157987 Aug 11 16:49:27.596441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 851/1970] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:27 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:27.638474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:27.646778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:27.648910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:27.650039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-64585505-e17f-4f8f-8bf4-a5b3cd4c2e53 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089875 Aug 11 16:49:27.650586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1120/1971] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:28.617112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:28.617877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:28.624389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:28.624858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:28.625297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:28.625994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:28.626472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:28.626895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:28.672619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:28.673230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:28.679813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:28.680482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:28.680916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:28.681605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:28.682055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:28.682470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:28.743711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:28.752399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:28.753848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:28.755102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bdda2b2b-e848-44ed-99b0-1981e352d650 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086466 Aug 11 16:49:28.755664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1121/1972] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:28.866936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:28.875331 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f412c9e-8be0-4af2-a476-b8db38156384 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.261789 Aug 11 16:49:28.875944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 852/1973] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:29.778597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:29.779167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:29.785667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:29.786143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:29.786573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:29.787257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:29.787706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:29.788143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:29.863047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:29.872310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:29.873811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:29.874945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-648d6fb9-22c2-4809-9468-344cb30abcbe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.101079 Aug 11 16:49:29.875498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1122/1974] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:29.896319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:29.896926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:29.904375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:29.904859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:29.905296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:29.905995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:29.906548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:29.906875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:30.049231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:30.058054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-498c4313-69b4-43c8-9a9e-d5b5bfd3be0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.165471 Aug 11 16:49:30.058466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 853/1975] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:29 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:30.896808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:30.897417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:30.903974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:30.904494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:30.904926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:30.905608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:30.906054 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:30.906474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:30.967287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:30.975890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:30.978298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:30.979434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5fb6a2a2-99a9-455b-9e72-a790af679511 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086610 Aug 11 16:49:30.979992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1123/1976] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:31.079355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:31.080010 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:31.087259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:31.087735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:31.088192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:31.088881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:31.089325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:31.089744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:31.215949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:31.223922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e9e1ba8d-16b8-44eb-b61e-419515abb9bc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148387 Aug 11 16:49:31.224533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 854/1977] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:32.002133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:32.002681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:32.009621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:32.010095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:32.010523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:32.011349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:32.011863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:32.012383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:32.075939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:32.084364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:32.085859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:32.086989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f07f32ab-ab16-4f90-8234-3a8829cdefc9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088903 Aug 11 16:49:32.087534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1124/1978] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:32.245475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:32.246085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:32.252548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:32.252975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:32.253410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:32.254092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:32.254540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:32.254962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:32.383058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:32.391026 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f04afd8-26ed-4ebf-a839-e2ba90af48b6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150105 Aug 11 16:49:32.391599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 855/1979] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:32 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:33.110305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:33.110905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:33.117822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:33.118301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:33.118732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:33.119407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:33.119854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:33.120310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:33.181876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:33.190400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:33.191912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:33.193084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a8ecc013-2470-40e8-b37f-a1ae297f155a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086650 Aug 11 16:49:33.193636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1125/1980] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:33.411519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:33.412039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:33.418580 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:33.419065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:33.419506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:33.420236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:33.420688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:33.421114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:33.549067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:33.557688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0702f487-b277-4512-9b12-aee3443e3f92 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150110 Aug 11 16:49:33.558262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 856/1981] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:34.217159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:34.217762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:34.224285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:34.224766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:34.225197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:34.226962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:34.227507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:34.227933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:34.291221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:34.299625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:34.301161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:34.302313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-edc50207-a541-4c46-ae99-0e09d0868565 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089049 Aug 11 16:49:34.302864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1126/1982] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:34 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:34.579398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:34.580011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:34.587713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:34.588213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:34.588656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:34.589346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:34.589801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:34.590226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:34.720199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:34.728618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7ebfc35c-1872-449b-ba4d-c51f24482b39 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153181 Aug 11 16:49:34.729190 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 857/1983] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:35.325680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:35.326236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:35.332583 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:35.333060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:35.333489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:35.334167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:35.334614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:35.335718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:35.395251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:35.404640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:35.406143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:35.407275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e10e0f61-9fd8-4846-a74a-05e3faddde28 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085543 Aug 11 16:49:35.407823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1127/1984] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:35.750679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:35.751298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:35.758608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:35.759086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:35.759524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:35.760250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:35.760706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:35.761133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:35.891280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:35.899304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-89b9e69d-d9f0-4ddf-aed5-92b38609e131 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152509 Aug 11 16:49:35.899874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 858/1985] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:36.429043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:36.429568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:36.436064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:36.436579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:36.437019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:36.437706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:36.438422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:36.438846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:36.499052 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:36.507698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:36.509243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:36.510387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-41d8e725-7787-4a91-b7ea-28f89e22910d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085442 Aug 11 16:49:36.510940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1128/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:36.920028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:36.920643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:36.927037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:36.927512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:36.927948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:36.929174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:36.929734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:36.930241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:37.060641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:37.068902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7eb0c535-edef-4920-a063-f5bb09462241 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152732 Aug 11 16:49:37.070271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 859/1987] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:36 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:37.533295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:37.533906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:37.540715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:37.541197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:37.541633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:37.542318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:37.542769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:37.543189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:37.603726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:37.612130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:37.613630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:37.614764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5c36a48a-38d5-493d-98c3-d1b788303385 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085445 Aug 11 16:49:37.615313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1129/1988] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:38.090980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:38.091591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:38.098008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:38.098482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:38.098913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:38.099592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:38.100034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:38.100482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:38.226567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:38.234424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d8b8c7cc-8062-4d57-a697-58ce9098f994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147412 Aug 11 16:49:38.234981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 860/1989] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:38 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:38.637165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:38.637775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:38.644294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:38.644775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:38.645208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:38.645891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:38.646342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:38.646765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:38.715895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:38.724261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:38.726442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:38.727574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-883bf332-3776-4854-8300-f98507899df7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.094344 Aug 11 16:49:38.728137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1130/1990] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:39.255733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:39.256361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:39.262972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:39.263448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:39.263880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:39.264588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:39.265037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:39.265451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:39.393996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:39.402440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f4935f16-4fcf-4889-82e2-49016d29dc8a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150581 Aug 11 16:49:39.403005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 861/1991] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:39.749188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:39.749798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:39.756269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:39.757240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:39.757676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:39.758359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:39.758810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:39.759241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:39.819969 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:39.828632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:39.830133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:39.831257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-76d9d8cb-3a0e-4b3a-9ff1-5592c0307f72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085965 Aug 11 16:49:39.831800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1131/1992] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:40.423134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:40.423743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:40.430949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:40.431419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:40.431877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:40.432605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:40.433079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:40.433496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:40.448374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:40.565124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:40.573089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c6388ed6-b391-4f76-814f-03a4dc2f546a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153917 Aug 11 16:49:40.573649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 862/1993] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:40.854242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:40.854845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:40.861243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:40.861719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:40.862145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:40.862820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:40.863265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:40.863681 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:40.924924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:40.933394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:40.934885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:40.936002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dee2ac25-ed28-4078-b91b-91d682ec7e6a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086249 Aug 11 16:49:40.936596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1132/1994] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:41.594252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:41.594858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:41.601870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:41.602349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:41.602785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:41.603475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:41.603927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:41.604372 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:41.736462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:41.744842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5d0ede49-13d6-4d93-a75a-abbd2e081a7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154488 Aug 11 16:49:41.745417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 863/1995] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:41.958485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:41.959037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:41.965545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:41.966020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:41.966446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:41.967120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:41.967563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:41.967977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:42.030711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:42.039644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:42.041174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:42.042309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d0089219-fbcb-44ed-a242-442ba468cb97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087794 Aug 11 16:49:42.042855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1133/1996] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:42.766426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:42.767031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:42.775124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:42.775604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:42.776036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:42.776748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:42.777204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:42.777739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:42.912539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:42.920988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7a8586a3-5589-41ad-a46c-fb65c2e71767 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158453 Aug 11 16:49:42.921558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 864/1997] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:42 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:43.065677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:43.066286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:43.072741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:43.073220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:43.073653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:43.074331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:43.074776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:43.075194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:43.137777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:43.146047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:43.148047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:43.149197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-95d4d7f2-904a-45d1-a345-432fc427a566 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087708 Aug 11 16:49:43.149754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1134/1998] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:43.792777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:49:43.792947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:49:43.942794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:43.943401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:43.950763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:43.951241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:43.951675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:43.952391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:43.952844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:43.953265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:44.081418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:44.089514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-865fc6e8-d6ec-4550-8a4b-8d51916c1ca3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150613 Aug 11 16:49:44.090078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 865/1999] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:43 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:49:44.173203 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:44.173847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:44.180825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:44.181297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:44.181726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:44.182400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:44.182844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:44.183262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:44.243794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:44.252134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:44.253624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:44.254754 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c90111b0-1585-46a3-a642-99bce5b5e979 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085806 Aug 11 16:49:44.255300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1135/2000] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:44 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:45.110786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:45.111399 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:45.117894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:45.118383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:45.118824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:45.119521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:45.119977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:45.120434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:45.249803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:45.257758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e660cf8b-5b27-4841-9953-69264a1cc860 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150833 Aug 11 16:49:45.258319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 866/2001] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:45 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:45.277828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:45.278466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:45.284907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:45.285386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:45.285822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:45.286513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:45.286964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:45.287385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:45.302618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:45.350428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:45.359064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:45.360677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:45.361839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-972f6d3c-162a-4cde-9118-e22ac2ca2ae2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087867 Aug 11 16:49:45.362394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1136/2002] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:46.278859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:46.279470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:46.285977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:46.286450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:46.286880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:46.287555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:46.288550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:46.288976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:46.385631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:46.386230 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:46.392615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:46.393094 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:46.393520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:46.394233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:46.394679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:46.395095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:46.418792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:46.426979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-da58b4a4-efb5-4b4d-84f0-ea1d299b3c66 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151823 Aug 11 16:49:46.427563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 867/2003] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:46.458019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:46.467113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:46.468648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:46.469785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4928262-135a-402d-ab38-78d758c5f573 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088141 Aug 11 16:49:46.470330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1137/2004] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:47.449651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:47.450208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:47.456681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:47.457154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:47.457583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:47.458257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:47.458701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:47.459116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:47.493620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:47.494225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:47.500717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:47.501204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:47.501635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:47.502326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:47.502775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:47.503249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:47.570565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:47.579027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:47.580567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:47.581716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c7149009-9bd8-4c9a-8ef3-1d969f228871 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092988 Aug 11 16:49:47.582468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1138/2005] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:47.592616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:47.601210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e6dc4395-c0a8-413a-9647-6e21994142a0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155503 Aug 11 16:49:47.601771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 868/2006] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:48.604823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:48.605436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:48.611812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:48.612328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:48.612760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:48.613435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:48.613887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:48.614300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:48.622994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:48.623620 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:48.630063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:48.630548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:48.630985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:48.631724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:48.632214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:48.632672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:48.675856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:48.685097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:48.686591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:48.687724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a718ccf6-2698-482e-b680-646d55b4f836 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087454 Aug 11 16:49:48.688568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1139/2007] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:48.763344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:48.771253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-50ef9a27-9866-4363-9079-1fe4aab5509b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152134 Aug 11 16:49:48.771809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 869/2008] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:49:49.710527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:49.711124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:49.717644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:49.718117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:49.718545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:49.719220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:49.719665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:49.720079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:49.780188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:49.788649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:49.790145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:49.791268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ceb5b5f7-2912-4197-9645-91a6081967ad tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084676 Aug 11 16:49:49.791808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1140/2009] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:49.792650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:49.793329 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:49.799567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:49.800135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:49.800645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:49.801392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:49.801920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:49.802404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:49.929787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:49.937691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-860bd668-c549-46ef-8cb6-b570f9fa6ba9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149105 Aug 11 16:49:49.938510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 870/2010] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:49 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:49:50.814749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:50.815352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:50.817707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:50.823670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:50.824274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:50.824767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:50.825445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:50.825891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:50.826311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:50.886335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:50.894729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:50.896274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:50.897585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-469fb3b2-8fc6-4eca-ab31-1b2abf2d9c84 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086812 Aug 11 16:49:50.898137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1141/2011] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:50.958652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:50.959267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:50.965918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:50.966395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:50.966831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:50.967518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:50.967969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:50.968417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:51.103044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:51.111171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-039ca026-2be1-4af6-ac6c-87ee76002436 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156338 Aug 11 16:49:51.111734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 871/2012] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:51.919345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:51.919951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:51.926374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:51.926849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:51.927294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:51.927950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:51.929067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:51.929490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:51.993142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:52.001434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:52.002924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:52.004076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a75bdea4-06b9-485c-b69e-cbbec7652dfd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088728 Aug 11 16:49:52.004657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1142/2013] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:52.132521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:52.133167 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:52.139663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:52.140169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:52.140607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:52.141289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:52.141737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:52.142156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:52.270592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:52.279093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6e47b110-b056-43d4-8685-d3ddc1481318 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150886 Aug 11 16:49:52.279663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 872/2014] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:52 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:53.026906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:53.027497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:53.034082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:53.034570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:53.035004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:53.035685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:53.036155 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:53.036578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:53.099565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:53.108388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:53.109894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:53.111025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-21a8fc9e-9c6e-4bf5-bacb-f65d14a27dd2 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088115 Aug 11 16:49:53.111580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1143/2015] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:53.301492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:53.302097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:53.309093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:53.309561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:53.309991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:53.310674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:53.311119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:53.311535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:53.437605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:53.445926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1f62140c-b724-4f0e-b3be-7ae74beba04f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148388 Aug 11 16:49:53.446494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 873/2016] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:54.134766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:54.135370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:54.141773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:54.142249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:54.142673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:54.143346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:54.143792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:54.144303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:54.204159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:54.212501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:54.213992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:54.215112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29b4d380-f35b-4fff-bc91-68515cfae59d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084811 Aug 11 16:49:54.215652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1144/2017] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:54 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:54.466993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:54.467558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:54.474127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:54.474607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:54.475043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:54.476354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:54.476806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:54.477230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:54.608487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:54.616390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-19b781c5-dc7e-46c4-a755-bcc492f52de5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153356 Aug 11 16:49:54.616956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 874/2018] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:55.237050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:55.237658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:55.244920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:55.245395 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:55.245827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:55.246507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:55.246956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:55.247374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:55.308327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:55.316939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:55.318438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:55.319569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a65c0b59-a60c-4a10-af50-2d7074f38e08 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086458 Aug 11 16:49:55.320147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1145/2019] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:55.637766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:55.638307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:55.644786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:55.645258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:55.645685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:55.646363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:55.646808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:55.647227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:55.773445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:55.781350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-003d21da-f6a7-48b3-b0a0-32134835252d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147539 Aug 11 16:49:55.781905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 875/2020] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:56.341955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:56.342500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:56.349006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:56.349503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:56.349930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:56.350845 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:56.351304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:56.351731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:56.414842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:56.423622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:56.425171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:56.426318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5becb4ff-4782-4022-8989-a7288248be05 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088375 Aug 11 16:49:56.426867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1146/2021] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:49:56.803020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:56.804304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:56.810807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:56.811291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:56.811728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:56.812445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:56.812900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:56.813586 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:56.944980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:56.952907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-239b2370-7a72-4f59-9f2e-b4b5cef03057 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153778 Aug 11 16:49:56.953507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 876/2022] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:56 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:57.449218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:57.449828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:57.456351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:57.456831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:57.457265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:57.457946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:57.458393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:57.458811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:57.520637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:57.529924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:57.531453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:57.532639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c1575dde-7b30-4fe3-ad06-bb2f49bdbef1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087288 Aug 11 16:49:57.533184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1147/2023] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:57.974350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:57.974900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:57.977260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=52 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:49:57.982877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:57.983362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:57.983803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:57.984534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:57.984991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:57.985420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:58.116736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:58.124628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2ba60007-cbb7-4994-b491-cef8698ad7cd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154345 Aug 11 16:49:58.125188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 877/2024] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:58.555789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:58.556417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:58.563451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:58.563935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:58.564394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:58.565084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:58.565534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:58.565957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:58.625693 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:58.634138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:58.635653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:58.636826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47eaf9e4-6915-44d6-9cd0-dd00afc1ed98 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085980 Aug 11 16:49:58.637381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1148/2025] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:49:59.146327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:59.147716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:59.154566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:59.155050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:59.155488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:59.156207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:59.156662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:59.157084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:59.209183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:49:59.209998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 (ip 10.222.0.43) !!! Aug 11 16:49:59.285478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:59.293949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-fc3adc91-793d-4cd0-8a8e-92bafc676aea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151590 Aug 11 16:49:59.294520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 878/2026] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:49:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:49:59.658810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:49:59.659360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:49:59.665844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:59.666320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:59.666748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:59.667426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:49:59.667876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:49:59.668322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:49:59.728772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:59.737304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:59.738799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:49:59.739925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a5808bd0-97a9-4249-8a88-b1a0f0f73eec tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085061 Aug 11 16:49:59.740511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1149/2027] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:49:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:00.315230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:00.315803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:00.322305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:00.322781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:00.323214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:00.323928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:00.324402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:00.324830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:00.328742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:00.456718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:00.465817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-72ab1e98-2ce8-44c6-bd19-d5d49d8f35c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154837 Aug 11 16:50:00.466381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 879/2028] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:00.762815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:00.763341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:00.770803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:00.771283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:00.771713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:00.772732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:00.773186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:00.773612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:00.839104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:00.848368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:00.850379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:00.851530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-add7423c-c563-4f53-a6f3-2fb91995fe2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092678 Aug 11 16:50:00.852077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1150/2029] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:01.486915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:01.487451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:01.494063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:01.494540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:01.494970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:01.495651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:01.496236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:01.496661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:01.621886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:01.629832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ec2ba40b-1990-4b8c-9880-80815584f827 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.146852 Aug 11 16:50:01.630398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 880/2030] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:50:01.874531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:01.875146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:01.882486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:01.882982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:01.883418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:01.884161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:01.884617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:01.885040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:01.945933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:01.954337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:01.955835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:01.957005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-05ebece1-d031-48c3-9227-c04842ed9ff7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086381 Aug 11 16:50:01.957552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1151/2031] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:02.651919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:02.652559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:02.658565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:02.659039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:02.659469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:02.660176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:02.660622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:02.661039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:02.980421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:02.980973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:02.987392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:02.987879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:02.988342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:02.989031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:02.989479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:02.989898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:03.012529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:03.020571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f43f5da4-d33c-48ed-81ec-b65fc10d031a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.372695 Aug 11 16:50:03.021141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 881/2032] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:03.051531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:03.060959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:03.062472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:03.063910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ccf95083-99dd-4e38-ba23-b0727e160b2c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087595 Aug 11 16:50:03.064508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1152/2033] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:04.043093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:04.043623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:04.049698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:04.050181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:04.050622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:04.051314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:04.051763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:04.052214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:04.086697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:04.087300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:04.093889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:04.094370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:04.094799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:04.095497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:04.095941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:04.096380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:04.099079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:04.158956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:04.168512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:04.170022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:04.171161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-59b8cff2-9817-43b1-88a3-bab0e152b618 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088874 Aug 11 16:50:04.171729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1153/2034] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:04.181710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:04.189883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b73ed569-f413-48ca-89c4-7633f7f9e2d3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152278 Aug 11 16:50:04.190458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 882/2035] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:05.194465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:05.195356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:05.201813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:05.202294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:05.202725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:05.203411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:05.203860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:05.204312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:05.211030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:05.211647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:05.218115 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:05.218604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:05.219042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:05.219733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:05.220222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:05.220645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:05.268382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:05.277594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:05.279108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:05.280293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-775acc2a-8664-4884-82b6-932a2354ccba tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090457 Aug 11 16:50:05.280850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1154/2036] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:05 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:05.350536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:05.358354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3c128e0b-9eda-4619-840d-dce6d074bc13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151845 Aug 11 16:50:05.358926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 883/2037] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:05 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:50:06.303670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:06.304326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:06.310853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:06.311281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:06.311714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:06.312417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:06.312869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:06.313556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:06.374129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:06.379759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:06.380401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:06.383082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:06.384625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:06.385899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20aa7ac8-d358-4329-91ff-903fcef3a5c1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086453 Aug 11 16:50:06.386355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1155/2038] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:06.387011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:06.387561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:06.388000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:06.388724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:06.389178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:06.389605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:06.517595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:06.526034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9f75fa7f-19b5-4c8f-807a-08f9ab6f90b8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150059 Aug 11 16:50:06.526605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 884/2039] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:50:07.408783 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:07.409350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:07.416272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:07.416756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:07.417188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:07.417869 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:07.418318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:07.418738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:07.482145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:07.490505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:07.492010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:07.493162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-191ff2b4-4604-4714-8480-8e7d31c10a56 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088379 Aug 11 16:50:07.493715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1156/2040] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:07.547370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:07.547969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:07.554472 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:07.554946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:07.555376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:07.556053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:07.556520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:07.556935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:07.684185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:07.692584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ad729344-ce5a-4ddf-8340-82990ec9c6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149060 Aug 11 16:50:07.693152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 885/2041] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:08.515831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:08.516404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:08.523271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:08.523739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:08.524193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:08.524870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:08.525311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:08.525726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:08.585453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:08.593864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:08.595374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:08.596551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-793ef4c3-6cf7-43b5-99b6-67c853b46c5d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084698 Aug 11 16:50:08.597116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1157/2042] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:08.714615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:08.716608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:08.721631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:08.722107 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:08.722537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:08.723209 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:08.723653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:08.724067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:08.856379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:08.864283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d9d89a07-addf-4986-963b-c215e5a32cdc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153928 Aug 11 16:50:08.864844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 886/2043] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:09.620045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:09.620675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:09.627069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:09.627548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:09.627982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:09.628700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:09.629152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:09.629572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:09.692594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:09.700961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:09.702469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:09.703602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-28dde0e5-7d03-4ccc-8b6d-2ee55e3024bd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088161 Aug 11 16:50:09.704175 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1158/2044] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:09.886023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:09.886560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:09.893002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:09.893478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:09.893914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:09.894610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:09.895059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:09.895485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:10.021343 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:10.029854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-62b1d044-d7fb-4feb-8887-d32a39a2e800 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147844 Aug 11 16:50:10.030422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 887/2045] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:10.725780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:10.726378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:10.732734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:10.733209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:10.733637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:10.734314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:10.734755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:10.735168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:10.794958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:10.803323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:10.805002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:10.806128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38c2d5d2-ea07-406f-a384-207e04c41715 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085055 Aug 11 16:50:10.806670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1159/2046] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:11.052037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:11.052688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:11.059130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:11.059605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:11.060034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:11.060742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:11.061187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:11.061602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:11.196192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:11.204275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2baa19f7-404a-4388-97e4-552eb3d75c13 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156156 Aug 11 16:50:11.204835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 888/2047] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:11.830547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:11.831154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:11.838408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:11.838888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:11.839322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:11.840007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:11.840488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:11.840910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:11.900884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:11.909169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:11.910671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:11.911802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b8bafe62-41fb-478e-9f37-1aef2068c2bb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085163 Aug 11 16:50:11.912586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1160/2048] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:12.224590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:12.225843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:12.232267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:12.232743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:12.233172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:12.233846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:12.234291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:12.234706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:12.359897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:12.368893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-da5b0d46-2e91-4491-8765-ccd0b8e6b3ee tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148224 Aug 11 16:50:12.369461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 889/2049] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:12 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:12.934601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:12.935210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:12.941908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:12.942387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:12.942817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:12.943504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:12.943951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:12.944512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:13.012743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:13.021112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:13.022942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:13.024087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-acc451a5-d503-4751-8b86-e9e68d8bf11f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.093436 Aug 11 16:50:13.024689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1161/2050] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:13.390870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:13.391481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:13.398000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:13.398473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:13.398906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:13.399588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:13.400038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:13.400490 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:13.531640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:13.540151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-18dd3814-a3b6-409a-892b-3304f25d4851 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153106 Aug 11 16:50:13.540721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 890/2051] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:14.046948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:14.047472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:14.055482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:14.055975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:14.056479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:14.057210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:14.057796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:14.058081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:14.121991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:14.130378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:14.132431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:14.133579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ef4022b-5beb-40b0-86bb-c5e7e74fe7a9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090714 Aug 11 16:50:14.134135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1162/2052] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:14.561874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:14.562488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:14.570016 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:14.570494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:14.570925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:14.571615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:14.572065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:14.572511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:14.700446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:14.708436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-52c75fbc-bc7c-4cc0-b431-6de80d25d5cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150370 Aug 11 16:50:14.709046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 891/2053] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:15.156466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:15.157067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:15.164127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:15.164622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:15.165050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:15.165721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:15.166167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:15.166585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:15.229810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:15.238389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:15.239916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:15.241127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bba474c4-9ecc-4ce1-b880-d947ba728422 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088634 Aug 11 16:50:15.241663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1163/2054] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:15 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:15.729838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:15.730450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:15.737009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:15.737497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:15.737926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:15.738609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:15.739062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:15.739484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:15.868238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:15.876424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b0958758-dd34-4f4d-8179-96a7450eebaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151643 Aug 11 16:50:15.876991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 892/2055] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:16.262708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:16.263336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:16.269880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:16.270360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:16.270789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:16.272013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:16.272554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:16.272943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:16.332802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:16.341825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:16.343376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:16.344534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fcd47a78-40c6-4eb7-a733-8d3489407aae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085693 Aug 11 16:50:16.345087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1164/2056] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:16.898073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:16.898716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:16.905117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:16.905621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:16.906051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:16.906729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:16.907173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:16.907592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:17.042157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:17.050116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac6e64ba-3c67-4812-8374-6f39fc17b7ff tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156624 Aug 11 16:50:17.050673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 893/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:17.367225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:17.367862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:17.374322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:17.374794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:17.375223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:17.375893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:17.376433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:17.376854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:17.437729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:17.446916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:17.448441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:17.449563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bbf896b1-6ce6-49d2-97d6-9c40aeca25fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086256 Aug 11 16:50:17.450105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1165/2058] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:18.071604 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:18.072245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:18.078702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:18.079181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:18.079623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:18.080336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:18.080784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:18.081204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:18.208210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:18.216980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-18b0004f-20ec-498e-ab95-6e8c8fda9de0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149414 Aug 11 16:50:18.217546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 894/2059] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:18.471982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:18.472567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:18.479735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:18.480252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:18.480687 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:18.481371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:18.481817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:18.482233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:18.546210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:18.554866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:18.556419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:18.557546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4a511288-f1e6-4d42-ae1b-66025c003534 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089558 Aug 11 16:50:18.558108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1166/2060] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:19.293887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:19.294444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:19.300869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:19.301346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:19.301780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:19.302466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:19.302916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:19.303337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:19.439810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:19.442000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:19.449378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2585c999-543a-4deb-b763-4ad615290c36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.159464 Aug 11 16:50:19.449947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 895/2061] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:19 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:19.581377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:19.581984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:19.588563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:19.589038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:19.589469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:19.590145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:19.590592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:19.591009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:19.651279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:19.659611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:19.661150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:19.662287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79cd46e4-6238-46d6-8f6f-d1d39e2909c8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084825 Aug 11 16:50:19.662846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1167/2062] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:20.469734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:20.470346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:20.477801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:20.478280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:20.478713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:20.480156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:20.480647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:20.481123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:20.610397 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:20.618915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a8deb28-7916-4b14-ac04-9b7873682801 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153140 Aug 11 16:50:20.619473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 896/2063] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:20.685240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:20.685841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:20.692522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:20.692992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:20.693415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:20.694091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:20.694616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:20.695067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:20.754686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:20.763491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:20.765019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:20.766146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f9507af9-598e-4aaa-88ec-e403e3316f12 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084824 Aug 11 16:50:20.766689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1168/2064] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:20 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:21.639054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:21.639584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:21.646062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:21.646538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:21.646972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:21.647759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:21.648253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:21.648675 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:21.789975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:21.790580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:21.792996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:21.798177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:21.798680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:21.799139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:21.799832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:21.800304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:21.800727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:21.827945 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:21.836018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a28ab023-0385-49e9-97bf-9b9159947037 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.200896 Aug 11 16:50:21.836623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 897/2065] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:21.864506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:21.868411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:21.874280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:21.875813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:21.876977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc88ccf6-bf5b-4a8b-9f36-fa270bd18508 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091822 Aug 11 16:50:21.877524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1169/2066] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:21 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:22.857218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:22.857839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:22.864238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:22.864710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:22.865141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:22.865818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:22.866772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:22.867198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:22.899446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:22.900119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:22.907233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:22.907726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:22.908189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:22.908901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:22.909352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:22.909778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:22.978585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:22.987605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:22.989149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:22.990322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-603c850a-e2a2-47a1-8b38-f75b3f4fe7fd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.095225 Aug 11 16:50:22.990892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1170/2067] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:22 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:23.151160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:23.158979 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f2936fd6-bc69-4693-8b70-1605a4da98d2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.305631 Aug 11 16:50:23.159528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 898/2068] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:24.013772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:24.014304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:24.020769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:24.021250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:24.021682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:24.022363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:24.023118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:24.023655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:24.085112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:24.093778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:24.095285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:24.096459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32a1cb0a-b602-4ec5-9fd2-f972a9e51491 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086650 Aug 11 16:50:24.097019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1171/2069] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:24 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:24.179374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:24.179996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:24.186441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:24.186918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:24.187349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:24.188030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:24.188765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:24.189183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:24.317736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:24.325667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-13a05539-ec86-47b8-81e8-f5a64e807103 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150678 Aug 11 16:50:24.326221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 899/2070] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:24 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:25.120283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:25.120964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:25.127327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:25.127808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:25.128292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:25.128981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:25.129434 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:25.129860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:25.190350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:25.199958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:25.201494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:25.202630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9d0637b4-84b5-4b2c-9304-8b28874df9bf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087091 Aug 11 16:50:25.203178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1172/2071] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:25 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:25.347289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:25.347831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:25.354851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:25.355325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:25.355755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:25.356465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:25.356916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:25.357335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:25.488772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:25.497308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f1e1d4d-bd9b-4526-bc18-61cd33666aa0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153901 Aug 11 16:50:25.497859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 900/2072] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:26.226468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:26.227070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:26.233762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:26.234243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:26.234675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:26.235364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:26.235815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:26.236289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:26.298521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:26.306916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:26.308491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:26.309567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6613e513-3d1b-43e2-8438-1ad643f77a2b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087523 Aug 11 16:50:26.310145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1173/2073] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:26 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:26.518850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:26.519440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:26.526097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:26.526572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:26.527007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:26.527694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:26.528236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:26.528660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:26.656628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:26.664690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f25e9d7c-9796-4a31-b525-58b4a29fdb20 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150020 Aug 11 16:50:26.665237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 901/2074] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:27.332622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:27.333168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:27.340141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:27.340628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:27.341062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:27.341743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:27.342193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:27.342613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:27.406620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:27.415038 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:27.416574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:27.417710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38f12a5f-4893-44e3-8349-cf8918446933 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089104 Aug 11 16:50:27.418273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1174/2075] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:27 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:27.685208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:27.685776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:27.692389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:27.692870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:27.693299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:27.693978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:27.695082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:27.695469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:27.825483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:27.833326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d668b32e-27fb-4b87-afd9-6c92b9554531 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152067 Aug 11 16:50:27.833875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 902/2076] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:27 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:50:28.440928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:28.441447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:28.448319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:28.448802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:28.449261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:28.449918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:28.450366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:28.450788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:28.513381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:28.521758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:28.523968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:28.525253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a290dc3-43db-4df5-a0b7-79648bc8fa95 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088615 Aug 11 16:50:28.525664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1175/2077] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:28 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:28.855003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:28.855608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:28.858019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=52 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:28.863332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:28.863804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:28.864264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:28.864974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:28.865419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:28.865836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:28.994268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:29.002175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d14ccd57-a23f-4779-8900-4c92a77eb843 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151042 Aug 11 16:50:29.002730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 903/2078] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:29.546923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:29.547531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:29.554204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:29.554867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:29.555388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:29.556251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:29.556761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:29.557225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:29.624519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:29.633117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:29.634646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:29.635780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c615ef76-5523-44fd-9b0d-6ab7957dbffe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092812 Aug 11 16:50:29.636353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1176/2079] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:29 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:30.024407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:30.025021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:30.031455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:30.031946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:30.032416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:30.033113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:30.033565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:30.033992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:30.163386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:30.171337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b90ba156-4286-474c-85a8-55ade8f6c8e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151611 Aug 11 16:50:30.171900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 904/2080] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:30 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:30.658263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:30.658846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:30.665493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:30.665966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:30.666392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:30.667066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:30.667512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:30.667933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:30.729926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:30.738736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:30.740298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:30.741449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1123a2fe-a121-413d-b990-e21d95841ffb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087125 Aug 11 16:50:30.742108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1177/2081] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:30 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:31.193386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:31.193999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:31.201225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:31.201705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:31.202141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:31.202837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:31.203290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:31.203716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:31.346165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:31.355085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b17357ea-683c-4990-b5ac-08490a789ffa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.165454 Aug 11 16:50:31.355662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 905/2082] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:31.765151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:31.766244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:31.774168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:31.774643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:31.775071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:31.775755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:31.776232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:31.776652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:31.847530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:31.856323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:31.857823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:31.859338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-544d2df3-ab85-4b85-aa72-a32c28c4da82 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.098837 Aug 11 16:50:31.860380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1178/2083] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:31 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:32.377705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:32.378253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:32.384863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:32.385349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:32.385788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:32.386483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:32.386935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:32.387359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:32.515398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:32.523504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-42f4a7a5-5b1f-46ec-996a-2b3ebfae6128 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149995 Aug 11 16:50:32.524067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 906/2084] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:32 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:32.885959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:32.886573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:32.893079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:32.893559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:32.893994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:32.894678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:32.895133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:32.895561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:32.956367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:32.964777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:32.966290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:32.967443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4b19096-7517-42a3-a985-2081bd2648cd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085443 Aug 11 16:50:32.968004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1179/2085] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:32 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:33.544567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:33.545175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:33.551629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:33.552123 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:33.552566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:33.553250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:33.553759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:33.554165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:33.690373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:33.698836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-51f86745-fcf8-437d-a459-d1079c4507e1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158134 Aug 11 16:50:33.699396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 907/2086] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:33.990163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:33.990778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:33.997760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:33.998259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:33.998679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:33.999391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:33.999842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:34.000297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:34.061553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:34.071050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:34.072587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:34.073724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-666b9df7-f243-4c33-9a6a-06a3b7c7dcc1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087547 Aug 11 16:50:34.074277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1180/2087] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:33 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:34.720495 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:34.721106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:34.728220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:34.728700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:34.729136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:34.729823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:34.730275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:34.730701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:34.861734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:34.870062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-224b1343-cf2f-4606-b27f-a551ba9b459f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153499 Aug 11 16:50:34.870610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 908/2088] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:35.095152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:35.095786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:35.102821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:35.103430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:35.103921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:35.104797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:35.105254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:35.105771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:35.167444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:35.175860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:35.177387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:35.178541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5a260e63-0868-42b1-807d-5d478ff0beb4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087274 Aug 11 16:50:35.179088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1181/2089] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:35 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:35.890811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:35.891426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:35.898228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:35.898703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:35.899136 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:35.899851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:35.900365 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:35.900820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:36.027717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:36.035698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1aafe713-770f-42c9-8cef-f9bd3f260c35 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148788 Aug 11 16:50:36.036353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 909/2090] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:36.201024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:36.201661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:36.208090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:36.208595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:36.209028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:36.210265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:36.210896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:36.211325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:36.276716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:36.285109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:36.286608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:36.288501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3e23085f-2b8d-41fb-ad34-8e7dfde96ce6 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090624 Aug 11 16:50:36.289216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1182/2091] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:36 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:37.057828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:37.058448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:37.065260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:37.065687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:37.066127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:37.066848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:37.067297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:37.067723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:37.197186 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:37.205145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f917dc01-ea45-43f4-89c3-91f68aa001fc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151626 Aug 11 16:50:37.205711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 910/2092] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:37 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:37.310641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:37.311254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:37.318062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:37.318486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:37.318921 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:37.319615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:37.320061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:37.320511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:37.379743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:37.388280 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:37.389831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:37.390980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e4989b02-b790-4b7a-bf2c-5d7474c20456 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.084216 Aug 11 16:50:37.391534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1183/2093] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:37 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:38.226415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:38.227024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:38.233576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:38.234057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:38.234489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:38.235178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:38.235623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:38.236045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:38.366718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:38.374765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2b50a214-2d5e-4200-847f-60051f53f073 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152190 Aug 11 16:50:38.375354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 911/2094] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:38 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:38.413443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:38.414126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:38.420552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:38.421025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:38.421454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:38.422131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:38.422577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:38.422993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:38.483529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:38.492585 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:38.494104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:38.495339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-94ac57b8-4b25-47f7-b156-8705737a11fe tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085871 Aug 11 16:50:38.495900 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1184/2095] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:38 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:39.396504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:39.397660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:39.404156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:39.404640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:39.405077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:39.405768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:39.406225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:39.406651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:39.421599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:39.518805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:39.519414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:39.525991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:39.526475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:39.526910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:39.527602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:39.528051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:39.528504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:39.540591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:39.548818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bbc2289d-91c7-4689-9549-85a775fd394d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156306 Aug 11 16:50:39.549382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 912/2096] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:39.589658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:39.598005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:39.599546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:39.601243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-20ea29f8-70ac-45e4-8945-be860491ded1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086347 Aug 11 16:50:39.601800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1185/2097] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:39 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:40.571641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:40.572279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:40.578893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:40.579378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:40.579848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:40.580602 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:40.581058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:40.581512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:40.624348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:40.624987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:40.631939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:40.632670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:40.632876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:40.633567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:40.634016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:40.634444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:40.649770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:40.698850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:40.707366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:40.708898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:40.710653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aad3b61e-19cc-42a1-8246-76af40b98810 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089675 Aug 11 16:50:40.711222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1186/2098] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:40 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:40.713657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:40.721736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1b96d988-f544-4003-8f0a-6adf25e76946 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154640 Aug 11 16:50:40.722292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 913/2099] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:41.732885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:41.733588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:41.740012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:41.740455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:41.741564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:41.742158 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:41.742599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:41.743018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:41.743251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:41.743868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:41.750356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:41.750841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:41.751285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:41.751990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:41.752471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:41.752899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:41.805631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:41.814550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:41.816068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:41.817242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-606bc66d-367a-413a-bfea-02104eb4f752 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088255 Aug 11 16:50:41.817806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1187/2100] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:41 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:41.886449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:41.894376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-50dc6214-fda8-4fbd-97d0-90b8de02e994 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155523 Aug 11 16:50:41.894944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 914/2101] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:42.840401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:42.840989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:42.847413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:42.847890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:42.848377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:42.849060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:42.849506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:42.849927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:42.910216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:42.914863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:42.915483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:42.919273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:42.920808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:42.921894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:42.922020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17060ae2-0471-45e2-9d6b-497ffc88d307 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085578 Aug 11 16:50:42.922377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:42.922485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1188/2102] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:42 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:42.922819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:42.923518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:42.923970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:42.924425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:43.053108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:43.061696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dc1487e4-d876-4d59-b8d5-1be3d54c2a7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150740 Aug 11 16:50:43.062263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 915/2103] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:42 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:50:43.944931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:43.945587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:43.951996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:43.952507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:43.952938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:43.953622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:43.954109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:43.954531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:44.017622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:44.026873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:44.028396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:44.029536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-447187a7-c729-4b25-824c-a1fcc22ed1ed tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088577 Aug 11 16:50:44.030092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1189/2104] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:43 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:44.083412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:44.084078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:44.091081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:44.091558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:44.091995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:44.092703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:44.093149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:44.093566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:44.228056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:44.235930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-75ea2605-2add-4c75-927c-b6ae69f9f02a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156375 Aug 11 16:50:44.236519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 916/2105] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:44 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:45.052332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:45.052936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:45.060275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:45.060756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:45.061185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:45.061870 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:45.062316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:45.062736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:45.128132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:45.136916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:45.138433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:45.139577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-73259bad-f15f-42a2-afdb-729500b0b174 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.091178 Aug 11 16:50:45.140149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1190/2106] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:45 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:45.256794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:45.257569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:45.264124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:45.264611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:45.265046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:45.265734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:45.266187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:45.266608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:45.404378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:45.412324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8cb628ba-c44b-4a3e-8b78-7e2e146f76c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.159367 Aug 11 16:50:45.413563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 917/2107] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:45 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:46.161853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:46.162486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:46.169412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:46.169893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:46.170320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:46.170999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:46.171444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:46.171867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:46.233651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:46.242601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:46.244150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:46.245274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-926bbf57-cc71-4b79-9270-da9a0ae649cc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087313 Aug 11 16:50:46.245826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1191/2108] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:46 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:46.434920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:46.435465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:46.442113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:46.442585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:46.443018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:46.443697 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:46.444170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:46.444588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:46.573656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:46.581688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-208f7a38-3c5c-455c-8911-1f182c847146 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150681 Aug 11 16:50:46.582246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 918/2109] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:47.268082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:47.268732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:47.275264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:47.275738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:47.276196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:47.276873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:47.277316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:47.277733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:47.338735 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:47.346992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:47.348506 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:47.349627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e60e3ef5-786f-45d5-bc10-e74824d04090 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085429 Aug 11 16:50:47.350724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1192/2110] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:47 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:47.603098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:47.603658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:47.610183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:47.610667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:47.611119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:47.611792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:47.612280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:47.612712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:47.754511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:47.763407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-80729142-c3b5-4c32-a1f4-35ebd665b32b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.164501 Aug 11 16:50:47.763966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 919/2111] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:48.371976 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:48.372543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:48.379066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:48.379548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:48.379985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:48.380712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:48.381170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:48.381916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:48.443582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:48.452248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:48.453756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:48.454897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51e50a9c-fbd5-4b38-8ac1-9d4300573a39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086950 Aug 11 16:50:48.455463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1193/2112] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:48 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:48.785355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:48.785892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:48.793055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:48.793558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:48.793988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:48.794666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:48.795111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:48.795530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:48.922173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:48.931060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d88c92e1-5b27-4b89-863c-9f0006c94b17 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149643 Aug 11 16:50:48.931618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 920/2113] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:49.478402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:49.478951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:49.485458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:49.485941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:49.486376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:49.487066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:49.487522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:49.487944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:49.550996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:49.560086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:49.561627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:49.562769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-219dc7f9-7ad2-4f42-8c7c-f928933e00f7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088978 Aug 11 16:50:49.563326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1194/2114] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:49 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:50:49.953298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:49.953901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:49.960999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:49.961475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:49.961905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:49.962583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:49.963028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:49.963445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:50.090613 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:50.098477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2a5cdfe9-7e23-48e3-9137-10c75191db10 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149048 Aug 11 16:50:50.099061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 921/2115] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:49 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:50.585708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:50.586322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:50.592821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:50.593301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:50.593737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:50.594428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:50.594905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:50.595328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:50.658438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:50.666711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:50.668241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:50.669378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69ee5551-738c-4f0d-bc85-b7a1074a8ebb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087791 Aug 11 16:50:50.669946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1195/2116] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:50 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:51.119772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:51.120410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:51.126845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:51.127328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:51.127765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:51.128493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:51.128951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:51.129375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:51.262287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:51.270203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f4aec6ef-5605-4ce0-8c8c-8c6ad7cf5db7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154380 Aug 11 16:50:51.270769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 922/2117] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:51 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:51.691839 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:51.692491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:51.698938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:51.699400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:51.699829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:51.700532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:51.700978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:51.701397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:51.761462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:51.770093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:51.771591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:51.773923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac09a5a6-9125-4f08-80ce-c64a3699786e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086188 Aug 11 16:50:51.774472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1196/2118] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:51 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:52.292228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:52.292833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:52.299204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:52.299677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:52.300127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:52.300824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:52.301267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:52.301684 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:52.428505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:52.437122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-df5c68a9-8f36-492e-8b92-0fa0ec89902f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149539 Aug 11 16:50:52.437893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 923/2119] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:52 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:52.795573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:52.796147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:52.798415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=56 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:52.804397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:52.804898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:52.805326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:52.806003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:52.806445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:52.806858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:52.868004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:52.876941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:52.878430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:52.879552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0193853a-9a4c-4b49-8893-420779d5e64b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087904 Aug 11 16:50:52.880121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1197/2120] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:52 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:53.458332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:53.458896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:53.465425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:53.465899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:53.466327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:53.467005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:53.467447 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:53.467861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:53.602258 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:53.610096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bdce91b8-04fe-4923-bfec-3c407b82ffc1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155715 Aug 11 16:50:53.610654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 924/2121] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:53.902545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:53.903152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:53.909544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:53.910025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:53.910456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:53.911138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:53.911589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:53.912012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:53.976498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:53.984923 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:53.986425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:53.987563 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9bfe3bf1-9cc9-4bad-bb04-db00b2c8ab97 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088918 Aug 11 16:50:53.988122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1198/2122] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:53 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:54.632272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:54.632887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:54.639292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:54.639769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:54.640235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:54.640919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:54.641367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:54.641788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:54.768597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:54.776626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ce593a3e-0710-4b34-8bce-a069b3d46fd6 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148659 Aug 11 16:50:54.777187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 925/2123] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:55.011295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:55.011832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:55.018206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:55.018679 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:55.019106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:55.019782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:55.020260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:55.020675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:55.081495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:55.090124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:55.091710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:55.092862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7bfff781-09d7-4cc7-9a00-ff2c3aca3be8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085594 Aug 11 16:50:55.093408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1199/2124] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:55 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:55.798166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:55.798806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:55.806418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:55.806900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:55.807334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:55.808018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:55.808496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:55.808923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:55.942305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:55.950874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9b3a58f3-e8b4-452f-bee3-6137075dd62d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156620 Aug 11 16:50:55.951456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 926/2125] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:56.116520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:56.117127 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:56.123511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:56.123989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:56.124463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:56.125201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:56.125670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:56.126095 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:56.189044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:56.198296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:56.199805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:56.200984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dc2ed096-316b-474e-b0a3-fc7a0456d7b4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088976 Aug 11 16:50:56.201549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1200/2126] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:56 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:56.972701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:56.973362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:56.980718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:56.981202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:56.981636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:56.982320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:56.982779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:56.983196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:57.110778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:57.118786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a929b85a-c6f9-4d51-9d3c-5eafc503a9c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150020 Aug 11 16:50:57.119357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 927/2127] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:56 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:57.223748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:57.224324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:57.230787 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:57.231271 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:57.231704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:57.232438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:57.232887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:57.233306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:57.293471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:57.301752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:57.303989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:57.305149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3835c0c7-6f3f-4bc2-96cd-de7cf90e968e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085350 Aug 11 16:50:57.305704 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1201/2128] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:57 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:58.140396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:58.141038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:58.147847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:58.148456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:58.148894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:58.149587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:58.150038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:58.150459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:58.279938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:58.287943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b44fd29e-1c76-488e-bd92-d5e3e6135881 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151429 Aug 11 16:50:58.288553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 928/2129] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:58 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:58.329223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:58.329770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:58.336751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:58.337241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:58.337663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:58.338349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:58.338800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:58.339228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:58.403792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:58.412199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:58.414105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:58.415243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c70ff7a6-f8c8-4b3b-98c5-7f53a219ba15 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.090175 Aug 11 16:50:58.415803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1202/2130] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:58 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:50:59.309938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:59.310476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:59.312892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=52 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:59.318783 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:59.319514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:59.319958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:59.320681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:59.321137 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:59.321569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:59.324430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:59.437791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:50:59.438433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:50:59.445485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:59.445979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:59.446417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:59.447116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:50:59.447567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:50:59.447992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:50:59.452121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:50:59.475869 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:59.484335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-767d6dcd-0068-4d06-9ab7-f29932d8702e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.178349 Aug 11 16:50:59.484906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 929/2131] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:50:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:50:59.510763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:59.519186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:59.520748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:50:59.522422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-71d3d1fb-9be7-44e7-bc84-5afb0b4febbc tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087999 Aug 11 16:50:59.522970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1203/2132] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:50:59 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:51:00.506873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:00.507493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:00.514831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:00.515319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:00.515758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:00.516480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:00.516935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:00.517361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:00.544651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:00.545263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:00.551708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:00.552225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:00.552662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:00.553398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:00.553844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:00.554266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:00.616349 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:00.625013 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:00.626526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:00.627711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5e631b90-fba9-46a5-bc2a-5878ff4893a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086998 Aug 11 16:51:00.628295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1204/2133] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:00 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:00.650574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:00.658609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5284f9df-4585-466a-ac99-5a80f8381b88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156323 Aug 11 16:51:00.659173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 930/2134] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:01.651807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:01.652387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:01.658721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:01.659194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:01.659622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:01.660326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:01.660780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:01.661196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:01.680030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:01.680679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:01.689918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:01.690652 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:01.691265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:01.692141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:01.692605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:01.693035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:01.723318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:01.732717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:01.734220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:01.735359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abfbc174-4648-4640-9c67-0e353ca8763d tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087539 Aug 11 16:51:01.735916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1205/2135] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:01 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:01.827683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:01.836499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ecaf7e97-3a8a-4d6c-8a98-93309e6f4039 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.160805 Aug 11 16:51:01.837071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 931/2136] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:02.759008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:02.759611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:02.766057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:02.766538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:02.766970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:02.767649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:02.768128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:02.768549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:02.832076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:02.841294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:02.842800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:02.843936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f960a2cc-6710-4029-abdf-2b474ba6a201 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089694 Aug 11 16:51:02.844530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1206/2137] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:02 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:02.858786 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:02.859402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:02.865543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:02.866020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:02.866455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:02.867145 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:02.867596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:02.868022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:02.995323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:03.003450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6155864f-bb62-4fda-8e57-44a64df034d4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148764 Aug 11 16:51:03.004009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 932/2138] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:03.866411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:03.867014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:03.873633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:03.874113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:03.874546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:03.875238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:03.875698 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:03.876245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:03.939616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:03.948725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:03.950228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:03.951353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4ee55059-4df7-461c-ad21-931587835a4e tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088969 Aug 11 16:51:03.952252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1207/2139] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:03 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:04.025388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:04.025933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:04.032439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:04.032921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:04.033356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:04.034045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:04.034496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:04.034919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:04.163071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:04.170988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-560e201c-7e91-4a5f-856b-1f489b7a9536 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149856 Aug 11 16:51:04.171555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 933/2140] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:04.974112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:04.975392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:04.981803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:04.982279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:04.982699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:04.983374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:04.983818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:04.984263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:05.046438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:05.055108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:05.056777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:05.057916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-abb82e2d-601d-423b-9208-cd2897a7beae tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087666 Aug 11 16:51:05.058464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1208/2141] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:04 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:05.193015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:05.194109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:05.200508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:05.200993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:05.201451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:05.202139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:05.202592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:05.203015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:05.333117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:05.341113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-48970a6a-3def-477a-a08a-b6b780035daa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152241 Aug 11 16:51:05.341677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 934/2142] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:05 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:06.080034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:06.080734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:06.087287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:06.087756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:06.088211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:06.088888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:06.089335 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:06.089757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:06.150128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:06.158544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:06.160050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:06.161212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3df5b1b-c279-41c3-bf7d-7bac0102752a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085045 Aug 11 16:51:06.161759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1209/2143] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:06 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:51:06.362673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:06.363197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:06.369759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:06.370243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:06.370682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:06.371375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:06.371825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:06.372287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:06.500960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:06.509581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a4c90c73-1051-4fad-bf75-ced5b5db638a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150857 Aug 11 16:51:06.510139 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 935/2144] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:07.187891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:07.188519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:07.195299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:07.195772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:07.196228 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:07.196914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:07.197359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:07.197776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:07.261380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:07.269697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:07.271187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:07.273497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-15a50388-655b-48e5-b405-60ec890df2a3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092966 Aug 11 16:51:07.274065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1210/2145] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:07 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:07.530436 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:07.530987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:07.538217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:07.538694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:07.539124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:07.539803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:07.540276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:07.540698 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:07.670483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:07.678886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7452e809-35bb-4639-b748-129941f41d9e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152419 Aug 11 16:51:07.679460 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 936/2146] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:08.295757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:08.296403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:08.303889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:08.304454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:08.304891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:08.305578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:08.306029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:08.306500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:08.368041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:08.376541 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:08.378064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:08.379213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c6f1be5e-aa3a-4852-8080-a48d0a6fe48b tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087470 Aug 11 16:51:08.379766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1211/2147] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:08 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:08.700169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:08.700707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:08.707103 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:08.707585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:08.708017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:08.708728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:08.709427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:08.709954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:08.839493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:08.847499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4c574d4-ad49-499d-b312-485ab8e262c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151301 Aug 11 16:51:08.848069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 937/2148] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:09.402091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:09.402639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:09.409494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:09.409973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:09.410421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:09.411082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:09.411524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:09.412589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:09.472440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:09.481423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:09.482903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:09.484030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c64215fb-fc86-4529-8469-e4ba915b2697 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.085985 Aug 11 16:51:09.484602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1212/2149] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:09 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:09.869424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:09.870567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:09.877705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:09.878178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:09.878606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:09.879283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:09.879725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:09.880360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:10.012892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:10.020732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-618a465b-b828-4735-9745-ca7dafa324ab tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155220 Aug 11 16:51:10.021320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 938/2150] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:10.507922 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:10.508535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:10.514990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:10.515471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:10.515904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:10.516631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:10.517081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:10.517504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:10.579107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:10.588161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:10.589678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:10.590820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-81bd859b-206c-4acd-b91e-c2084936fc74 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087786 Aug 11 16:51:10.591374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1213/2151] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:10 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:11.042205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:11.042840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:11.049142 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:11.049621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:11.050055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:11.050742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:11.051194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:11.051617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:11.181173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:11.189714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c5a30a27-f3ef-495d-9314-27f02eb1feda tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151518 Aug 11 16:51:11.190380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 939/2152] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:11.613187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:11.613798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:11.620848 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:11.621326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:11.621758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:11.622436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:11.622886 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:11.623306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:11.685671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:11.694891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:11.696419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:11.697550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2caa4b62-0b7b-472d-bd33-3798923254a5 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088237 Aug 11 16:51:11.698105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1214/2153] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:11 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:12.211464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:12.212064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:12.218476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:12.218947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:12.219374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:12.220051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:12.220520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:12.220939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:12.353017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:12.360848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ef66c90-c836-4491-ad8b-46058da8794d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153415 Aug 11 16:51:12.361406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 940/2154] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:12 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:12.720333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:12.720896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:12.727738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:12.728246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:12.728688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:12.729371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:12.729820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:12.730241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:12.792808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:12.801151 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:12.803316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:12.804683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-96d40ef2-1788-413e-9054-423e195ab202 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088375 Aug 11 16:51:12.805241 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1215/2155] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:12 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:13.383112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:13.383632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:13.390102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:13.390582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:13.391017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:13.391705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:13.392176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:13.392600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:13.526214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:13.534098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-523b8cc2-09a3-459a-a533-5a9e0fa5f43f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155864 Aug 11 16:51:13.534657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 941/2156] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:13.826809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:13.827413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:13.834617 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:13.835229 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:13.835665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:13.836371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:13.836824 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:13.837245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:13.899728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:13.908466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:13.909983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:13.911119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3e19182-3ea4-47a2-a6d9-e8ccd387259c tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.088228 Aug 11 16:51:13.911666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1216/2157] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:13 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:14.555332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:14.555954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:14.562615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:14.563101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:14.563540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:14.564514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:14.564968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:14.565394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:14.695400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:14.703360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1875e1e3-a062-4e14-b764-f706934e1da8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152439 Aug 11 16:51:14.703934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 942/2158] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:14.933968 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:14.934539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:14.941139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:14.941614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:14.942045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:14.942720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:14.943206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:14.943625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:15.005588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:15.014043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:15.015538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:15.016725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f71eee74-aecf-41ae-8d5b-46b1b8b7ddcf tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086712 Aug 11 16:51:15.017337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1217/2159] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:14 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:15.724618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:15.725358 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:15.731577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:15.732053 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:15.732516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:15.733195 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:15.733640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:15.734059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:15.865124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:15.872955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-50c9a3ef-6cb4-492e-b01a-f1cad6a98cd7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152462 Aug 11 16:51:15.873518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 943/2160] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:16.039505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:16.040027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:16.046545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:16.047022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:16.047452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:16.048159 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:16.048608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:16.049046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:16.113354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:16.122287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:16.123781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:16.124936 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bac95c93-39e3-4119-9961-73b0d9564362 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.089561 Aug 11 16:51:16.125480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1218/2161] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:16 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:16.894373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:16.894973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:16.902059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:16.902532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:16.902962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:16.903642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:16.904090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:16.904525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:17.036194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:17.044957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-61e496fd-76d3-4e18-88d9-3199ea976560 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154427 Aug 11 16:51:17.045534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 944/2162] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:17.148027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:17.148613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:17.155043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:17.155522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:17.155957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:17.156673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:17.157129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:17.157555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:17.218432 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:17.220620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:17.228609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:17.230128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:17.231276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-49bbc9a6-066d-4c8a-8038-b915737acf11 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.087263 Aug 11 16:51:17.231827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1219/2163] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:17 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:18.066970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:18.067582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:18.074068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:18.074540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:18.074970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:18.075655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:18.076133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:18.076551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:18.205701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:18.207889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:18.214983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-16fec53c-3a30-4f9b-a0a6-3f4301b9c3f3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Aug 11 16:51:18.215548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 945/2164] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:18.253444 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:18.254056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:18.261144 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:18.261628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:18.262065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:18.262750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:18.263199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:18.263623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:18.325304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:18.333689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:18.335198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:18.336365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-00304549-cb0b-46b2-9bad-fb9e899a8859 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.086736 Aug 11 16:51:18.336928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1220/2165] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:18 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:19.236800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:19.237398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:19.244928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:19.245410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:19.245847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:19.246544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:19.246997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:19.247423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:19.358468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:19.359072 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:19.366190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:19.366614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:19.367044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:19.367725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:19.368197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:19.368612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:19.386756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:19.394803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-10a78879-b0df-4d8e-b8b7-78728a0272f4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.162137 Aug 11 16:51:19.395370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 946/2166] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:19 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:19.434431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:19.443894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:19.445665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:19.446807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-96baa02d-5848-4ed2-b12d-ccd7c4945c00 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 200 len: 1445 microversion: 2.20 time: 0.092209 Aug 11 16:51:19.447361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1221/2167] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:19 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:19.469376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9cc68785-7b2f-47cf-9428-abb317168eb7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '.version_select at 0x7f61480c6c10>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:19.491630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9cc68785-7b2f-47cf-9428-abb317168eb7 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266333986" status: 204 len: 0 microversion: 2.20 time: 0.026067 Aug 11 16:51:19.492207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 947/2168] 10.222.0.43 () {60 vars in 1262 bytes} [Thu Aug 11 16:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266333986 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 16:51:20.253488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-afb3e627-d615-404c-af12-f26dd1d7a798 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'create', calling method: .version_select at 0x7f6143376af0>, body: {"keypair": {"name": "tempest-keypair-1170195616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBePoMQ16RK9nL0ggNYg1p3cCz6v5krJCjWnPaV8Qs3ioR36IHLyLK55taYbcqezNP7u46JPVfl0MiWkytAFsDB2MdZkkHRqZP1iyYJ04o/meiS4HWmZe1m7HbA9n5D1QA=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:51:20.269864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-afb3e627-d615-404c-af12-f26dd1d7a798 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:51:20.274504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-afb3e627-d615-404c-af12-f26dd1d7a798 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for user 60ee85a52c0244879f10e8943d20dfb8 and project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:51:20.300794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-afb3e627-d615-404c-af12-f26dd1d7a798 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051173 Aug 11 16:51:20.301394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1222/2169] 10.222.0.43 () {62 vars in 1200 bytes} [Thu Aug 11 16:51:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 16:51:20.417512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:20.418198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:20.424862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:20.425416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:20.425917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:20.426707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:20.427746 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:20.428293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:20.611779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:20.621503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0ac3836d-35fb-4979-9609-e244002a1019 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.208709 Aug 11 16:51:20.622419 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 948/2170] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:21.578696 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-47223198", "imageRef": "fd39c497-2a8b-4105-961d-f3f42e445b5c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e733066a-89a4-41d8-b60f-23e6365a8bd8"}], "security_groups": [{"name": "tempest-securitygroup--1210847916"}], "key_name": "tempest-keypair-1170195616", "user_data": "}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:51:21.643500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:21.644146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:21.652034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:21.652557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:21.652991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:21.653690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:21.654143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:21.654568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:21.681067 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] validate_networks() for [('e733066a-89a4-41d8-b60f-23e6365a8bd8', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 16:51:21.785998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:21.794863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bb82d47b-0d3d-49d9-a992-d484261af3af tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155163 Aug 11 16:51:21.795659 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 949/2171] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:22.095545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 16:51:22.095974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 16:51:22.096486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 16:51:22.096928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 16:51:22.097370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 16:51:22.106631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:22.107110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:22.107547 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:22.108316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:22.108771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:22.109195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:22.126145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 16:51:22.130279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Getting quotas for user 60ee85a52c0244879f10e8943d20dfb8 and project fa83645c0fed4133b9eaf4c67e2bbad8. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 16:51:22.142071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 16:51:22.144326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd39c497-2a8b-4105-961d-f3f42e445b5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 16:51:22.187180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [5d4ca8ab-3d09-4c6e-9c89-37c7487b0ee3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 16:51:22.817040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:22.817656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:22.825236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:22.825718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:22.826157 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:22.826851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:22.827301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:22.827730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:22.968680 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:22.977863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2ae84871-f24e-45b2-8e30-907974487f43 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.164887 Aug 11 16:51:22.978445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 950/2172] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:23.036210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0fc3780e-5a1d-4a47-aad0-ed576c1c1175 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] Calling method '.version_select at 0x7f614bd8a940>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:23.057817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0fc3780e-5a1d-4a47-aad0-ed576c1c1175 tempest-TestVolumeBootPattern-1921281785 tempest-TestVolumeBootPattern-1921281785-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-584603698" status: 202 len: 0 microversion: 2.1 time: 0.025403 Aug 11 16:51:23.058410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 951/2173] 10.222.0.43 () {58 vars in 1260 bytes} [Thu Aug 11 16:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-584603698 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 16:51:23.196901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [5d4ca8ab-3d09-4c6e-9c89-37c7487b0ee3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 48726. Aug 11 16:51:23.201868 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3408dcef-4b19-4c87-97bf-99b3c78159a1 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.627450 Aug 11 16:51:23.202512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1223/2174] 10.222.0.43 () {62 vars in 1188 bytes} [Thu Aug 11 16:51:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 11 16:51:23.214086 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:23.214692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:23.310223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:23.319504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:23.321153 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:23.322361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6888e07a-0f6a-4792-9b7d-24a790dff9be tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1280 microversion: 2.20 time: 0.112912 Aug 11 16:51:23.323001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 952/2175] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:23 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:51:23.999356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:24.000077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:24.002113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:24.007457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:24.007935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:24.008474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:24.009114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:24.009561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:24.009987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:24.147831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:24.156285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3d1fad4-3cbe-45e2-b960-daf8e807396b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.160969 Aug 11 16:51:24.157171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1224/2176] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:23 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:24.344741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:24.345416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:24.352583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:24.353163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:24.353672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:24.354451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:24.354973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:24.355469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:24.433966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:24.442264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:24.444433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:24.445568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9182be6f-8229-4b10-a149-6884ace43461 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1338 microversion: 2.20 time: 0.104958 Aug 11 16:51:24.446112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 953/2177] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:24 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:25.178801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:25.179451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:25.185851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:25.186331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:25.186777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:25.187437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:25.187879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:25.188324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:25.470588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:25.471398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:25.478997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:25.479774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:25.480359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:25.481172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:25.481719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:25.482239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:25.560320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:25.569533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3440e025-ff33-4440-8c1f-8d82cef0fd0a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.395179 Aug 11 16:51:25.570123 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1225/2178] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:25.731156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:25.750033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:25.756997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:25.759410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ea35cced-dd4d-4ae2-8cac-a68bb48bbfb0 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.293704 Aug 11 16:51:25.760705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 954/2179] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:25 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:26.423154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae854b2-5a06-4265-bde5-211833f2cff3", "tag": "51f9f849-257d-4e57-b19e-1ec402f89cd8"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:51:26.435122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:26.435602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:26.436378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:26.448669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] Creating event network-changed:51f9f849-257d-4e57-b19e-1ec402f89cd8 for instance fae854b2-5a06-4265-bde5-211833f2cff3 on hv-cinder-85220 Aug 11 16:51:26.454219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-3747ab94-dc79-4eff-ac70-18a0fc7437ae req-c1cc732c-5268-4e69-b324-ca9ab2affa76 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100275 Aug 11 16:51:26.455321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1226/2180] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:51:26.590981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:26.591717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:26.598730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:26.600075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:26.600778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:26.601709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:26.602375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:26.603017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:26.783125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:26.784198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:26.793344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:26.793831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:26.794433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:26.795337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:26.795792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:26.796245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:26.996807 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:27.006305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:27.008196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:27.009580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1e096457-82c8-4920-94cf-a280c8c53e72 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.231193 Aug 11 16:51:27.010209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1227/2181] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:26 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:51:27.129960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:27.139299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7f3650b2-038b-42b2-9a24-fc155f705237 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.552225 Aug 11 16:51:27.152918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 955/2182] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:28.033033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:28.033725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:28.040042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:28.040548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:28.040979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:28.041664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:28.042109 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:28.042531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:28.163636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:28.164286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:28.171976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:28.172811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:28.173309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:28.174232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:28.174668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:28.175155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:28.185575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:28.195027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:28.197294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:28.198521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a14f1fd4-52c0-4706-976d-8ce2ee50c15a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.169646 Aug 11 16:51:28.200742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1228/2183] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:28 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:28.485894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:28.496413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b1b24567-b9d2-4476-b603-925957eb5570 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.337321 Aug 11 16:51:28.496999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 956/2184] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:29.222329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:29.222943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:29.232389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:29.233182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:29.234402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:29.235298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:29.235914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:29.236534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:29.497855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:29.517173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:29.517936 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:29.522437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:29.526259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:29.527638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:29.528318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:29.528691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:29.529537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:29.529752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bbe98169-de7a-477e-9cc6-11cdeeedaf41 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.311358 Aug 11 16:51:29.530681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:29.531359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:29.532051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:29.547381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1229/2185] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:29 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 16:51:29.675450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:29.684815 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0b5a8147-779c-498e-b1d8-24ed6d2cf4d1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.171619 Aug 11 16:51:29.685671 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 957/2186] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:29 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:30.555781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:30.556495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:30.565649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:30.566050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:30.566492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:30.567195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:30.568521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:30.569236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:30.704530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:30.706684 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:30.708013 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:30.713825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:30.715294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:30.715420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:30.715778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:30.716482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:30.716619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-58327cdf-ed57-4a46-b1dc-84e428c5a7eb tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.166674 Aug 11 16:51:30.717190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1230/2187] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:30 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:30.717655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:30.718238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:30.718818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:30.916804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:30.930859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0516de55-2ade-4793-9cfd-cc32daa0d034 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.227817 Aug 11 16:51:30.931448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 958/2188] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:30 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:31.739099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:31.740182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:31.746207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:31.746676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:31.751787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:31.752782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:31.754318 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:31.757315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:31.862912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae854b2-5a06-4265-bde5-211833f2cff3", "name": "network-vif-plugged", "status": "completed", "tag": "51f9f849-257d-4e57-b19e-1ec402f89cd8"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:51:31.882811 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:31.883404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:31.884030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:31.899974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] Creating event network-vif-plugged:51f9f849-257d-4e57-b19e-1ec402f89cd8 for instance fae854b2-5a06-4265-bde5-211833f2cff3 on hv-cinder-85220 Aug 11 16:51:31.909003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-add4aa23-3003-48e1-a2f3-def0d2f5228e req-bbb948ea-e724-4ec4-8f89-91f9276b9992 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238141 Aug 11 16:51:31.916503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1231/2189] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:51:31.954254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:31.955212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:31.974392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:31.974994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:31.976596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:31.978016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:31.978880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:31.979625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:32.057109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:32.066963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:32.070720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:32.072292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e83c0212-b0e4-4da5-8067-59b61d061222 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.336958 Aug 11 16:51:32.079366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 959/2190] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:31 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:32.117562 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:32.138265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=10 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:32.177831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:32.185990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b54374bb-b30f-4c6b-abfc-05e434a2310b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.236037 Aug 11 16:51:32.186982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1232/2191] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:33.096271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:33.096880 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:33.103459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:33.103934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:33.104395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:33.105075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:33.105516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:33.105933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:33.208137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:33.209333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:33.215984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:33.216524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:33.216964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:33.217657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:33.218120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:33.218550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:33.241296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:33.249305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:33.250810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:33.251921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c612db23-0217-4868-b478-7d8d5ab6577f tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1406 microversion: 2.20 time: 0.159575 Aug 11 16:51:33.252499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 960/2192] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:33 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:33.349372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:33.357481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1f132457-7814-45b6-9144-24dbd6cdbbb2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153231 Aug 11 16:51:33.358047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1233/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:34.274896 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:34.275502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:34.277334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:34.283122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.283600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.284199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.284886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.285333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.285752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.378831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:34.379713 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:34.386800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.387288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.387723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.388443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.388896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.389320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.418299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:34.426221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:34.427969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:34.429163 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-33926541-0448-4440-9d15-82ad68192ff8 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1598 microversion: 2.20 time: 0.158295 Aug 11 16:51:34.429720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 961/2194] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:51:34 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:51:34.452081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:34.452727 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:34.459380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.459854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.460317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.461017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:34.461470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:34.461892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:34.525392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:34.533293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a9670533-f596-42db-b02b-c47fe380edcd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158582 Aug 11 16:51:34.533851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1234/2195] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:51:34.543510 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1f136db8-29ab-4326-a5f7-ac753c9a6585 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095343 Aug 11 16:51:34.544236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 962/2196] 10.222.0.43 () {60 vars in 1316 bytes} [Thu Aug 11 16:51:34 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 16:51:35.462451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae854b2-5a06-4265-bde5-211833f2cff3", "tag": "51f9f849-257d-4e57-b19e-1ec402f89cd8"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:51:35.472174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:35.472651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:35.473080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:35.484446 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] Creating event network-changed:51f9f849-257d-4e57-b19e-1ec402f89cd8 for instance fae854b2-5a06-4265-bde5-211833f2cff3 on hv-cinder-85220 Aug 11 16:51:35.490431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-f82ddce5-e63e-4f51-86db-822c2ca8afe0 req-87c253c0-048b-4e8d-96bb-4b138e978faf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031099 Aug 11 16:51:35.491267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1235/2197] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:51:35.556375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:35.557006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:35.563124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:35.563544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:35.563976 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:35.564964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:35.565415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:35.565839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:35.742359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:35.750455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e78984f7-3a4c-45e5-8751-326f23727912 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.199430 Aug 11 16:51:35.751354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 963/2198] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:36.772966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:36.773579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:36.779671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:36.780169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:36.780600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:36.781265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:36.781715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:36.782129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:36.914732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:36.922692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ba9085fc-f44a-4acf-933e-34fbdd7e07f0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154744 Aug 11 16:51:36.923248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1236/2199] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:36 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:37.945476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:37.946093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:37.952663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:37.953152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:37.953593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:37.954288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:37.954745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:37.955171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:38.084814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:38.092730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-16f0b6fe-56b0-40cb-b2b1-bb879b2a2fdf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152070 Aug 11 16:51:38.093300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 964/2200] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:37 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:39.114069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:39.115493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:39.122036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:39.122517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:39.122946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:39.123627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:39.124071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:39.124520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:39.258621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:39.266629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5586523-d35d-435e-8c92-aeee44ff5147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156428 Aug 11 16:51:39.267190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1237/2201] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:40.288968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:40.289577 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:40.296027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:40.296532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:40.296965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:40.297643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:40.298088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:40.298504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:40.432822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:40.435056 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=100 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:40.442953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e7bd1270-1296-4d21-9f93-3e62fbe6de59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.157574 Aug 11 16:51:40.443514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 965/2202] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:41.464344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:41.464984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:41.471377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:41.471856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:41.472334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:41.473014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:41.473461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:41.475053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:41.603551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:41.611669 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2786102c-b709-4fbf-a7ec-7949bb2d47fd tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151298 Aug 11 16:51:41.612260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1238/2203] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:42.632883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:42.633492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:42.640006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:42.640522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:42.640962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:42.641655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:42.642110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:42.642536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:42.769645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:42.777743 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-126d4d68-eed9-4cce-8906-e65eeeafb7a7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148819 Aug 11 16:51:42.778311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 966/2204] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:42 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:43.799106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:43.799983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:43.807985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:43.808501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:43.808955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:43.809633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:43.810074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:43.810490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:43.940846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:43.948961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2081ef52-3854-4251-b2fd-a8ba3e293857 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154060 Aug 11 16:51:43.949518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1239/2205] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:43 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:44.970516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:44.971112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:44.978272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:44.978752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:44.979191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:44.981050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:44.981535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:44.981970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:45.112811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:45.122558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8a637e10-4323-420b-892d-c81194e35d97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155926 Aug 11 16:51:45.123177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 967/2206] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:44 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:46.144290 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:46.144990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:46.152262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:46.152743 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:46.153177 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:46.153861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:46.154314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:46.154738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:46.158779 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:46.289029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:46.299359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3401d45a-a882-467e-a68e-2ddc62545cea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158954 Aug 11 16:51:46.299927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1240/2207] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:47.321855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:47.322391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:47.328883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:47.329363 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:47.329794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:47.330481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:47.330931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:47.331353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:47.460442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:47.468521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-621fda90-0ede-4758-b9b6-af964208fa65 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151100 Aug 11 16:51:47.469095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 968/2208] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:48.490438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:48.491000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:48.497557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:48.498043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:48.498481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:48.499171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:48.499628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:48.500055 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:48.628303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:48.636201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-30035925-f415-4e3b-b420-2a33b36bd7a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150201 Aug 11 16:51:48.636759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1241/2209] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:49.657413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:49.658022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:49.665055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:49.665528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:49.665957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:49.666636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:49.667082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:49.667497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:49.794825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:49.803900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-67d0a498-a45c-4a5b-bdac-fd5b08105acf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150376 Aug 11 16:51:49.804501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 969/2210] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:49 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:50.826104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:50.826715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:50.833712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:50.834193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:50.834626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:50.835308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:50.835759 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:50.836214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:50.969584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:50.978039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d7fea1fd-b42c-4f67-b822-a6043270d297 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155820 Aug 11 16:51:50.978604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1242/2211] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:51.999934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:52.000563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:52.007897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:52.008394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:52.008826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:52.009509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:52.009956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:52.010376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:52.140856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:52.149267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9e0b7b2e-28d4-4134-9700-6fe613147a05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153246 Aug 11 16:51:52.149837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 970/2212] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:51 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:52.652476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:51:52.652715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:51:53.169842 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:53.170450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:53.178111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:53.178590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:53.179027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:53.179706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:53.180180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:53.180608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:53.306324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:53.314551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-635f4bf3-620a-4653-aaa4-36bf3df228e0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148272 Aug 11 16:51:53.315060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1243/2213] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:54.337955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:54.338517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:54.345301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:54.345779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:54.346210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:54.346889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:54.347338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:54.347755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:54.475625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:54.483645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e5e12e40-84aa-4bbf-a3ad-895ad6192b76 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150255 Aug 11 16:51:54.484225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 971/2214] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:55.504128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:55.505362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:55.507931 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=40 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:51:55.513205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:55.513723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:55.514162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:55.514853 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:55.515308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:55.515737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:55.647504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:55.655387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b9f3693e-3b46-4217-a0c9-b66c86a4ea5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155263 Aug 11 16:51:55.655948 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1244/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:56.677668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:56.678303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:56.684823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:56.685306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:56.685751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:56.686444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:56.686903 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:56.687328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:56.819090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:56.827401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9b9278ab-0682-4e67-8164-6afedc47d8e9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154186 Aug 11 16:51:56.828066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 972/2216] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:56 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:57.849509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:57.850146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:57.856322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:57.856815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:57.857246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:57.857928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:57.858379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:57.858802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:57.985973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:57.993904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29c4aa90-7afe-49cb-ae98-c58e77a44aa8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148723 Aug 11 16:51:57.994468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1245/2217] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:51:59.014276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:51:59.014897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:51:59.021348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:59.021835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:59.022277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:59.022975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:51:59.023429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:51:59.023956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:51:59.155169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:51:59.163654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-03f4e36a-7361-45c9-9163-7d30398ae176 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153305 Aug 11 16:51:59.164234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 973/2218] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:51:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:00.185174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:00.185778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:00.193186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:00.193663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:00.194091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:00.194768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:00.195212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:00.195628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:00.321577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:00.329497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-029e9338-c140-4c9e-8da7-a9937d50938e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148160 Aug 11 16:52:00.330063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1246/2219] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:01.351655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:01.352228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:01.354509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=34 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:01.359723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:01.360233 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:01.360666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:01.361352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:01.361800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:01.362246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:01.493899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:01.501851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b0dd1297-0036-47a6-aa0c-0f842109746c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154987 Aug 11 16:52:01.502414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 974/2220] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:02.524050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:02.524624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:02.531051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:02.531530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:02.531960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:02.532672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:02.533121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:02.533540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:02.664611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:02.672474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6b0521cf-4710-489a-ac4d-9585111749c3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152679 Aug 11 16:52:02.673037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1247/2221] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:03.694225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:03.701049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:03.702999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:03.703478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:03.703907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:03.704611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:03.705059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:03.705476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:03.836276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:03.844302 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41731fbc-4f2a-48e6-9d97-6fd9315f2ead tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154877 Aug 11 16:52:03.844858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 975/2222] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:03 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:04.865410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:04.865995 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:04.872449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:04.872920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:04.873341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:04.874016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:04.874462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:04.875233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:05.005304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:05.013263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-555a2ffd-b82c-4c05-86b0-8f457cdae260 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152401 Aug 11 16:52:05.013830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1248/2223] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:06.035213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:06.035758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:06.042874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:06.043366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:06.043804 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:06.044539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:06.044993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:06.045417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:06.173904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:06.181985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7c1039e9-44b0-48e1-ac25-fe2d9e08fde8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150708 Aug 11 16:52:06.182556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 976/2224] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:07.203483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:07.204115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:07.211747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:07.212278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:07.212715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:07.213399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:07.213859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:07.214286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:07.345065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:07.353833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d69d74a8-e284-49f5-bbcc-8ffab2157fe8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154322 Aug 11 16:52:07.354399 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1249/2225] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:08.375127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:08.375664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:08.382296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:08.382775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:08.383202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:08.383884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:08.384352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:08.384769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:08.515912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:08.524297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-13d2973f-6db3-4f04-b998-0dfe35c2c967 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153056 Aug 11 16:52:08.524864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 977/2226] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:09.545325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:09.545874 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:09.553284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:09.553763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:09.554193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:09.554871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:09.555317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:09.555733 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:09.681427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:09.689261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-80f548bb-be0d-42ff-8ae1-3a15f39f35a1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147830 Aug 11 16:52:09.690077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1250/2227] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:10.711104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:10.711750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:10.718228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:10.718709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:10.719144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:10.719832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:10.720314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:10.720740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:10.724073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=74 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:10.849339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:10.857346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-17d801df-0247-4b90-b4fc-88437f0de15c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150754 Aug 11 16:52:10.857912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 978/2228] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:10 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:11.585866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:11.586424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:11.593002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:11.593491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:11.593929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:11.594840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:11.595297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:11.595727 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:11.619686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2bc520bd-add1-4e61-a8aa-19e7eeffc4a4 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3/ips" status: 200 len: 152 microversion: 2.20 time: 0.038295 Aug 11 16:52:11.620285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1251/2229] 10.222.0.43 () {60 vars in 1289 bytes} [Thu Aug 11 16:52:11 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 16:52:11.879082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:11.879834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:11.886081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:11.886568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:11.887008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:11.887737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:11.888212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:11.888645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:12.017865 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:12.026507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4195384e-a933-4745-bb4e-621bef278fbe tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151572 Aug 11 16:52:12.027106 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 979/2230] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:13.046804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:13.047415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:13.055007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:13.055494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:13.055925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:13.056661 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:13.057773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:13.057773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:13.185575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:13.193915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d00f0f55-5158-494c-b2eb-df1bb7744fb1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150970 Aug 11 16:52:13.194463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1252/2231] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:14.214636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:14.215246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:14.221701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:14.222175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:14.222607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:14.224307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:14.224307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:14.224694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:14.353450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:14.361309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c6a6cd7e-05ac-47b6-9a17-6469446093fa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150574 Aug 11 16:52:14.361858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 980/2232] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:15.383018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:15.383626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:15.390510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:15.390988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:15.391420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:15.392128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:15.392566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:15.392981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:15.524580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:15.532439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a577f268-40c4-4c1a-9ddf-8b967308b670 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153343 Aug 11 16:52:15.532998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1253/2233] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:16.553508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:16.554152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:16.560724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:16.561307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:16.561633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:16.562325 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:16.562777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:16.563203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:16.691054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:16.699913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e3bc49a3-9074-43e8-8487-2fd305b87f23 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150482 Aug 11 16:52:16.700492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 981/2234] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:17.721691 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:17.722313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:17.729712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:17.730193 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:17.730628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:17.731315 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:17.731767 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:17.732223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:17.736142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=82 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:17.860204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:17.868947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8c30bd5e-1e4b-4dce-8451-5c0b2fe841dc tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151215 Aug 11 16:52:17.869509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1254/2235] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:17 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:18.891375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:18.892047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:18.899295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:18.899762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:18.900214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:18.900893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:18.901338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:18.901753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:19.030790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:19.039387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-96a55154-d2eb-4952-97ce-276ebb48957b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151717 Aug 11 16:52:19.040029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 982/2236] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:20.060405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:20.061014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:20.068720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:20.069195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:20.069624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:20.070300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:20.070747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:20.071161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:20.423576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:20.431991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8250dcf3-09f4-4619-99c2-4a17c811e960 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.375463 Aug 11 16:52:20.432572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1255/2237] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:21.701481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:21.702095 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:21.708785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:21.709264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:21.709701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:21.710391 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:21.710847 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:21.711277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:21.836974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:21.844833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-56ed8cbf-3e03-4a1d-ae3a-307be7e241a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.394895 Aug 11 16:52:21.845402 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 983/2238] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:22.867443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:22.868051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:22.874453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:22.874930 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:22.875358 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:22.876031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:22.876501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:22.876917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:23.006536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:23.014345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-055cad1f-f237-483a-baaf-8ba2c88f328c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150967 Aug 11 16:52:23.014906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1256/2239] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:24.035541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:24.036203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:24.042964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:24.043389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:24.043831 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:24.044616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:24.045322 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:24.045756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:24.178192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:24.186111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3b596f50-a964-4668-9189-7bada36db40e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154649 Aug 11 16:52:24.186668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 984/2240] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:24 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:25.208023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:25.208658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:25.215025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:25.215501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:25.215926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:25.216625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:25.217068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:25.217484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:25.346490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:25.354950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-21da2b58-9d65-4756-9f0d-5f340762817b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150849 Aug 11 16:52:25.355519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1257/2241] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:26.376809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:26.377378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:26.384637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:26.385120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:26.385559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:26.386277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:26.386738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:26.387160 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:26.515651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:26.523674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-81d9be11-4348-4c5d-9e9c-d526cab29000 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150820 Aug 11 16:52:26.524283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 985/2242] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:27.546756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:27.547360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:27.549722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:27.555124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:27.555592 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:27.556019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:27.556722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:27.557163 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:27.557575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:27.683851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:27.692573 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a4863bb-fda5-443f-b790-9b44ad2fe907 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149656 Aug 11 16:52:27.693120 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1258/2243] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:27 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:28.712994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:28.713596 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:28.720029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:28.720538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:28.720971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:28.721656 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:28.722105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:28.722794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:28.861536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:28.870621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f8377e05-c4e8-4888-a626-ee5282c2b98d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.161510 Aug 11 16:52:28.871201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 986/2244] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:29.892226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:29.892841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:29.899561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:29.900039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:29.900504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:29.901190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:29.901640 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:29.902062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:30.028344 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:30.036332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0b8d962e-e7b4-4e8b-a0b0-9d4b547d26aa tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148234 Aug 11 16:52:30.036924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1259/2245] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:29 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:31.057868 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:31.058485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:31.065238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:31.065721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:31.066883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:31.067681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:31.068156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:31.068585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:31.207168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:31.215669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3d1b1dad-c902-4266-ac9a-b3b69d4b532a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.161665 Aug 11 16:52:31.216252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 987/2246] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:32.237411 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:32.238004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:32.244478 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:32.244955 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:32.245386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:32.246066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:32.246511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:32.246935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:32.378263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:32.386912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1b9d6f93-fd0f-4ca0-9dfe-5ec93bcfefa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153505 Aug 11 16:52:32.387491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1260/2247] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:32 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:33.409511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:33.410148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:33.412600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=28 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:33.417777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:33.418250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:33.418678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:33.419357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:33.419802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:33.420259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:33.549097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:33.557655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-95cc1a71-6ec4-4630-b17f-55b2e4da904c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152300 Aug 11 16:52:33.558218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 988/2248] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:34.579881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:34.580545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:34.587111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:34.587588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:34.588017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:34.588716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:34.589162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:34.589578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:34.716551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:34.725188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-234a4263-fd05-48f2-b9fc-5aa989cb0d7c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149126 Aug 11 16:52:34.725749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1261/2249] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:35.746972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:35.747579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:35.754933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:35.755405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:35.755836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:35.756557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:35.757004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:35.757424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:36.126506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:36.135211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3744a141-88d2-4515-a2db-b2bdab0e2e34 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.392044 Aug 11 16:52:36.135787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 989/2250] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:37.156904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:37.157522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:37.164760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:37.165244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:37.165685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:37.166370 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:37.166826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:37.167249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:37.305493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:37.313521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-522672a0-80c1-475e-8978-52b133543bd1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.160470 Aug 11 16:52:37.314028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1262/2251] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:37 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:38.336367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:38.336886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:38.343271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:38.343747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:38.344207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:38.344890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:38.345334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:38.345751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:38.473560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:38.483077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4057ad60-3f43-4589-aa28-78df73c8ae89 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151587 Aug 11 16:52:38.483647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 990/2252] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:38 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:39.504257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:39.505329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:39.511896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:39.512405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:39.512847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:39.513524 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:39.513978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:39.514401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:39.643380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:39.651279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-926b14cf-62bc-4c5f-9390-79369026c672 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150906 Aug 11 16:52:39.651833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1263/2253] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:40.672605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:40.673217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:40.680421 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:40.680898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:40.681327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:40.682009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:40.682454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:40.682871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:40.814213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:40.816704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=82 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:40.823932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ef041d8a-2a5e-4788-8d38-07a72b31b1a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155222 Aug 11 16:52:40.824540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 991/2254] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:41.844622 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:41.845226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:41.851729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:41.852231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:41.852662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:41.853334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:41.853780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:41.854195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:41.983771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:41.992053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f8631162-5d9e-4436-b812-293a2ded3b97 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151365 Aug 11 16:52:41.992642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1264/2255] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:43.013947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:43.014821 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:43.021874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:43.022359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:43.022797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:43.023484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:43.023934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:43.024383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:43.151912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:43.159805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cfbfde24-75a4-41bb-8e1d-ffad5b6aa0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149756 Aug 11 16:52:43.160404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 992/2256] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:43 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:44.182544 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:44.183152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:44.189620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:44.190366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:44.190797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:44.191476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:44.191927 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:44.192857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:44.320677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:44.328534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-67da57ad-f6b5-48ec-920e-89fd926dbbb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149839 Aug 11 16:52:44.329097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1265/2257] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:44 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:45.351420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:45.351997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:45.358452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:45.358933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:45.359375 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:45.360077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:45.360551 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:45.360973 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:45.496664 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:45.504824 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-774e347e-2fad-4642-91c6-1524d37e1eb7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158308 Aug 11 16:52:45.505512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 993/2258] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:45 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:46.525896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:46.526467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:46.533061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:46.533528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:46.533964 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:46.534652 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:46.535106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:46.535531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:46.663049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:46.671555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3228c4b8-12ee-4e21-a296-6001ae65d657 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149618 Aug 11 16:52:46.672136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1266/2259] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:47.693568 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:47.694178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:47.700603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:47.701099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:47.701546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:47.702204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:47.702654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:47.703071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:47.830239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:47.838748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-42d5bf7d-0652-4b3c-be4a-fd4864b8d900 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149582 Aug 11 16:52:47.839305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 994/2260] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:48.859738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:48.860436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:48.867407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:48.867882 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:48.868343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:48.869022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:48.869465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:48.869881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:48.873757 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=78 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:49.000773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:49.008618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1ecb7146-06e7-4ae4-beab-9a1bcdc98d98 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152705 Aug 11 16:52:49.009176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1267/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:50.030015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:50.030630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:50.038290 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:50.038770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:50.039213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:50.039904 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:50.040381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:50.040807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:50.168715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:50.177761 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-20f890c3-0f9a-40ab-bd99-0249be75694b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151455 Aug 11 16:52:50.178355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 995/2262] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:51.199101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:51.199710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:51.206107 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:51.206581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:51.207006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:51.207680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:51.208708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:51.209221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:51.341568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:51.350245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bdfb2535-a812-4ed2-863f-f158b23f9553 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154910 Aug 11 16:52:51.350793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1268/2263] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:51 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:52.372855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:52.373400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:52.379956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:52.380470 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:52.380911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:52.381606 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:52.382064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:52.382489 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:52.514711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:52.522894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ed599bdd-1871-41f5-9e6d-166e0eb1fe6e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155064 Aug 11 16:52:52.523463 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 996/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:52 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:53.544559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:53.545131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:53.551523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:53.552723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:53.553152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:53.553830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:53.554295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:53.554697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:53.687061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:53.695578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8994a6b8-5ea3-4ab7-94d9-e1ebac6ba2cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155060 Aug 11 16:52:53.696186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1269/2265] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:54.717889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:54.718497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:54.725452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:54.725934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:54.726366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:54.727052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:54.727506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:54.727929 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:54.855044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:54.862884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9abf4fc6-61ea-4642-b170-698501464dd5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148962 Aug 11 16:52:54.863441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 997/2266] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:55.885351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:55.885971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:55.892430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:55.892914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:55.893351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:55.894035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:55.894493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:55.894913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:56.020843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:56.028858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fc3363d0-b51e-42d6-85a8-5b2d6025d4e7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147366 Aug 11 16:52:56.029423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1270/2267] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:57.050632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:57.051252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:57.058100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:57.058587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:57.059021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:57.059721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:57.060205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:57.060632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:57.199177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:57.207165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-760327e7-4454-4620-a027-86c4e838935b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.160376 Aug 11 16:52:57.207736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 998/2268] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:58.228461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:58.229080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:58.231028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:52:58.236267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:58.236746 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:58.237169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:58.237846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:58.238292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:58.238710 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:58.365311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:58.373216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-430f2c71-8841-4673-bfaf-fe9557b3b314 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149738 Aug 11 16:52:58.373768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1271/2269] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:58 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:52:59.397597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:52:59.397597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:52:59.403240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:59.404175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:59.404618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:59.405312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:52:59.405767 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:52:59.406191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:52:59.534556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:52:59.543315 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-58256d4a-e8c4-4abe-9ab3-c7fdd2054943 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152363 Aug 11 16:52:59.543878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 999/2270] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:52:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:00.564539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:00.565441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:00.571821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:00.572328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:00.572761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:00.573433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:00.573878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:00.574291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:00.704030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:00.711987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-71a5c19c-a6c8-4e50-8991-9db0b7715251 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151267 Aug 11 16:53:00.712580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1272/2271] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:01.733492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:01.734030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:01.741371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:01.741849 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:01.742286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:01.742978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:01.743427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:01.743852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:01.876867 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:01.885347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cda2c0cd-31e7-488d-b07f-de1b66114d03 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155786 Aug 11 16:53:01.885911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1000/2272] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:02.905792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:02.906400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:02.913572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:02.914046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:02.914475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:02.915156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:02.915632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:02.916049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:03.044526 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:03.054139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7b402b1c-3d0a-4490-9139-bef527e03f6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152554 Aug 11 16:53:03.054718 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1273/2273] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:04.075012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:04.075543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:04.077477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=26 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:04.082702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:04.083685 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:04.084301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:04.084989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:04.085433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:04.085851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:04.219547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:04.228348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ded60cde-47a4-4c99-8cb6-bcfe68661cba tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.157388 Aug 11 16:53:04.228912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1001/2274] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:05.250766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:05.251403 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:05.257975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:05.258450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:05.258878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:05.259564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:05.260011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:05.260578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:05.389608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:05.398130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4180221a-e2b5-4404-bdb8-9e086164a147 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151255 Aug 11 16:53:05.398694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1274/2275] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:05 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:06.420159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:06.420768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:06.427663 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:06.428170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:06.428610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:06.429292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:06.429738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:06.430155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:06.557237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:06.565366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f945e4c0-8ce4-4828-a4c4-2b82431eaf3b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148938 Aug 11 16:53:06.565919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1002/2276] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:07.587329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:07.587984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:07.594384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:07.594857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:07.595281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:07.595957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:07.596426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:07.596844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:07.722846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:07.731534 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cf246eef-c1fd-4e77-a000-94852fd54e88 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148555 Aug 11 16:53:07.732091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1275/2277] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:08.752621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:08.753237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:08.760299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:08.760775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:08.761201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:08.761881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:08.762324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:08.762739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:08.897565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:08.905449 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b1d56340-6852-44be-ba8d-736b8a7d2ccf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156722 Aug 11 16:53:08.906009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1003/2278] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:09.926412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:09.927020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:09.933875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:09.934364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:09.934793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:09.935509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:09.936061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:09.936539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:10.068525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:10.076475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-349963bb-0096-4c97-bcc3-9441e8b8df3a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153872 Aug 11 16:53:10.077034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1276/2279] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:11.097923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:11.098574 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:11.105504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.105985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.106418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.107104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.107555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.107974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.111907 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=74 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:11.234794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:11.243481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a35a2aac-9abe-41ee-b4b0-f1eced40a0d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149483 Aug 11 16:53:11.244049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1004/2280] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:11.695492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:11.696024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:11.702505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.702987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.703419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.704139 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.704578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.704983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.733428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 16:53:11.811941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-458f68e1-08f5-43ca-9160-6f7551154fcd tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 204 len: 0 microversion: 2.20 time: 0.120807 Aug 11 16:53:11.812971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1277/2281] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Aug 11 16:53:11 2022] DELETE /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 16:53:11.822126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:11.822730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:11.829505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.829985 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.830616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.831301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:11.831744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:11.832185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:11.968381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:11.977348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:11.978884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:11.980038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8d9bb529-eec7-445c-9df5-5d4cb1ece7f9 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1723 microversion: 2.20 time: 0.162182 Aug 11 16:53:11.980617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1005/2282] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:53:11 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:53:12.266174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:12.266827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:12.273523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:12.274002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:12.274435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:12.275118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:12.275572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:12.275992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:12.404477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:12.413032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60ee26e9-6821-4acf-aab5-ce0adaa57d59 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151092 Aug 11 16:53:12.413594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1278/2283] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:12 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:13.004558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:13.005191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:13.012654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:13.013159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:13.013590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:13.014283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:13.014729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:13.015148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:13.141952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:13.150144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:13.151672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:13.152920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2950a46b-61e6-4e97-ab26-bd02c6770a37 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1723 microversion: 2.20 time: 0.152225 Aug 11 16:53:13.153484 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1006/2284] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:53:12 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:53:13.434604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:13.435244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:13.441960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:13.442439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:13.442867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:13.443589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:13.444030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:13.444471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:13.577337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:13.586146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-75af1119-89fd-4d97-93c8-4570cde1612a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155099 Aug 11 16:53:13.586737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1279/2285] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:13.978078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae854b2-5a06-4265-bde5-211833f2cff3", "name": "network-vif-deleted", "tag": "51f9f849-257d-4e57-b19e-1ec402f89cd8"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 16:53:13.988176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:13.988715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:13.989093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.001089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] Creating event network-vif-deleted:51f9f849-257d-4e57-b19e-1ec402f89cd8 for instance fae854b2-5a06-4265-bde5-211833f2cff3 on hv-cinder-85220 Aug 11 16:53:14.007782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-3665162a-6783-4e01-9790-f4f176a8860f req-07bfcd6b-1031-442d-86fc-ad8fe16887d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Aug 11 16:53:14.008444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1007/2286] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 16:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 16:53:14.175085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:14.175695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:14.183051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:14.183528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:14.183954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.184675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:14.185118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:14.185728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.219091 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:14.219570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:14.220000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.220472 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lazy-loading 'fault' on Instance uuid fae854b2-5a06-4265-bde5-211833f2cff3 {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 16:53:14.265417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:14.274512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:14.276009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60ee85a52c0244879f10e8943d20dfb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa83645c0fed4133b9eaf4c67e2bbad8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:14.277210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-79a139d2-b60b-41f3-9d3f-aa019d8ccc39 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 200 len: 1370 microversion: 2.20 time: 0.106167 Aug 11 16:53:14.277772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1280/2287] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:53:14 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 16:53:14.609225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:14.609951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:14.616153 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:14.616625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:14.617052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.617736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:14.618212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:14.618631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:14.757524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:14.765570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a6f1a1fb-7461-4057-bb84-69c27fa008b9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.161244 Aug 11 16:53:14.766131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1008/2288] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:53:15.299975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:15.300613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:15.308047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.308557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.308993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.309678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.310157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.310578 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.325367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] HTTP exception thrown: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Request method failure captured: Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 HTTP/1.1 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4elzkBopKVyhdT-ecT9kZiXN2z2x65OT-S5Jr7VfBZ4ugiA8EUB0xBtVuA15B4Q5euI43ajP1ilS2adJb1Ynlg9m5xqoFU_KtXWYadEq4kVhmea8q89GYx7P1yd9AthCAoHO27S7R2PUSi5QGxuv_8gJ3FLkYoxpW_9yHlqsNFKGA Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:53:15.326989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa83645c0fed4133b9eaf4c67e2bbad8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}] Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 60ee85a52c0244879f10e8943d20dfb8 Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:15.329024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'fae854b2-5a06-4265-bde5-211833f2cff3'} Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:53:15.330108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:15.331762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:15.333213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Returning 404 to user: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:53:15.333213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-40a1a59a-fe53-4ea3-8d91-926d30518bb3 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 404 len: 111 microversion: 2.20 time: 0.032291 Aug 11 16:53:15.333213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1281/2289] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:53:15 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:53:15.337297 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4c4d2d85-7c49-4f8d-a6d9-2b56fd0d9591 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '.version_select at 0x7f6143e625e0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:15.356184 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4c4d2d85-7c49-4f8d-a6d9-2b56fd0d9591 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170195616" status: 204 len: 0 microversion: 2.20 time: 0.022777 Aug 11 16:53:15.356782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1009/2290] 10.222.0.43 () {60 vars in 1262 bytes} [Thu Aug 11 16:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170195616 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 16:53:15.787961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:15.788523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:15.794481 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.794970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.795410 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.796130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.796593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.797023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.813438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:15.936939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:15.946023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8200a83e-24c4-416a-bc89-b17711456754 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.162198 Aug 11 16:53:15.946750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1282/2291] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:15.974646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:15.975146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:15.982176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.982665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.983104 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.983797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:15.984289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:15.984716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:15.998467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] HTTP exception thrown: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Request method failure captured: Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 HTTP/1.1 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4elzkBopKVyhdT-ecT9kZiXN2z2x65OT-S5Jr7VfBZ4ugiA8EUB0xBtVuA15B4Q5euI43ajP1ilS2adJb1Ynlg9m5xqoFU_KtXWYadEq4kVhmea8q89GYx7P1yd9AthCAoHO27S7R2PUSi5QGxuv_8gJ3FLkYoxpW_9yHlqsNFKGA Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:53:16.000338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa83645c0fed4133b9eaf4c67e2bbad8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}] Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 60ee85a52c0244879f10e8943d20dfb8 Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.001851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'fae854b2-5a06-4265-bde5-211833f2cff3'} Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:53:16.002712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.004150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.006336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Returning 404 to user: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:53:16.006336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c8e59694-927f-4698-b004-0e01988d7653 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 404 len: 111 microversion: 2.20 time: 0.031679 Aug 11 16:53:16.006336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1010/2292] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Aug 11 16:53:15 2022] DELETE /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:53:16.011522 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:16.012160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: fae854b2-5a06-4265-bde5-211833f2cff3] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:16.018034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:16.018507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:16.018937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:16.019613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:16.020060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:16.020502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:16.033781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] HTTP exception thrown: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Request method failure captured: Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 HTTP/1.1 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4elzkBopKVyhdT-ecT9kZiXN2z2x65OT-S5Jr7VfBZ4ugiA8EUB0xBtVuA15B4Q5euI43ajP1ilS2adJb1Ynlg9m5xqoFU_KtXWYadEq4kVhmea8q89GYx7P1yd9AthCAoHO27S7R2PUSi5QGxuv_8gJ3FLkYoxpW_9yHlqsNFKGA Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:53:16.035293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa83645c0fed4133b9eaf4c67e2bbad8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}] Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 60ee85a52c0244879f10e8943d20dfb8 Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.037047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'fae854b2-5a06-4265-bde5-211833f2cff3'} Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:53:16.038070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. Aug 11 16:53:16.039792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:53:16.041213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Returning 404 to user: Instance fae854b2-5a06-4265-bde5-211833f2cff3 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:53:16.041213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f24a707-345c-400c-9905-a09bb725197a tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3" status: 404 len: 111 microversion: 2.20 time: 0.028974 Aug 11 16:53:16.041213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1283/2293] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:53:16 2022] GET /compute/v2.1/servers/fae854b2-5a06-4265-bde5-211833f2cff3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:53:16.966531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:16.967199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:16.973948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:16.974651 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:16.975089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:16.975770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:16.976249 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:16.976668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:17.108336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:17.116702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-844714ba-e118-4925-b366-3687c5cb7911 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154060 Aug 11 16:53:17.117256 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1011/2294] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:18.138062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:18.138612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:18.145128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:18.145615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:18.146110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:18.146971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:18.147423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:18.147849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:18.389338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:18.397236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-46a8cdc7-0f2a-476b-8df9-ad1e4cf8a047 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.263096 Aug 11 16:53:18.397790 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1284/2295] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:19.219467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:53:19.220048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:53:19.418759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:19.419362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:19.426036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:19.426522 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:19.426988 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:19.428527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:19.429006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:19.429430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:19.557409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:19.565694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a1d6ef01-b05f-4aa4-9322-34ee92c97cd4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150563 Aug 11 16:53:19.566260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1012/2296] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:19 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:20.586763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:20.587365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:20.593856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:20.594329 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:20.594756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:20.595438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:20.595883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:20.596327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:20.720326 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:20.728962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-669240d4-1ec9-48f4-965a-d5fe8ff3705e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.146052 Aug 11 16:53:20.729519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1285/2297] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:21.750215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:21.750829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:21.757933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:21.758417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:21.758855 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:21.759542 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:21.760001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:21.760570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:21.887851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:21.895762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aa8f044d-30bf-4297-98d5-ec8c8c2de4cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149468 Aug 11 16:53:21.896856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1013/2298] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:22.918602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:22.919216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:22.926178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:22.926658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:22.927099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:22.928406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:22.928941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:22.929289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:23.071447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:23.079389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f1fee201-9992-4dfe-bc89-cf0efeb42261 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.164558 Aug 11 16:53:23.079947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1286/2299] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:24.102390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:24.102939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:24.109377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:24.109851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:24.110283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:24.110975 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:24.111422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:24.111845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:24.242251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:24.250441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-66ac4d93-b544-4ee5-b544-2c671c1ea89d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152641 Aug 11 16:53:24.251011 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1014/2300] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:24 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:25.272728 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:25.273366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:25.279863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:25.280381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:25.280820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:25.281512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:25.281967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:25.282391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:25.410455 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:25.418587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0ca6b45-494e-4bbb-83e2-8c1f008ba77b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150477 Aug 11 16:53:25.419160 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1287/2301] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:26.440158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:26.441022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:26.447932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:26.448439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:26.448872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:26.449552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:26.450000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:26.450413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:26.582711 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:26.590782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac7a17c2-3bab-41ec-bc69-4399c57f7723 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154614 Aug 11 16:53:26.591335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1015/2302] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:27.611514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:27.612135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:27.619339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:27.619817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:27.620287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:27.620973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:27.621426 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:27.621849 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:27.750675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:27.758719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9e61b5aa-dc6f-4b41-bd8d-c487f45a0fa3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151089 Aug 11 16:53:27.759289 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1288/2303] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:27 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:28.778823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:28.779438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:28.785932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:28.786416 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:28.787518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:28.788242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:28.788701 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:28.789128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:28.919119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:28.927074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-51783c8b-f406-4ba7-8d4a-f5e1bef854bf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152182 Aug 11 16:53:28.927779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1016/2304] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:29.948957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:29.949571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:29.951445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:29.956793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:29.957277 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:29.957714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:29.958402 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:29.958953 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:29.959468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:30.090150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:30.098062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4873a9d0-2dd2-4e2a-b595-d1286effa8c5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153111 Aug 11 16:53:30.098626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1289/2305] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:29 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:31.120257 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:31.120873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:31.127390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:31.127871 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:31.128339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:31.129033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:31.129493 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:31.129915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:31.364618 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:31.372738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-77a43543-3256-4b55-9b76-340c3f9a556b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.256687 Aug 11 16:53:31.373314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1017/2306] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:32.395235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:32.395771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:32.409642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:32.410171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:32.410614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:32.411327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:32.411772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:32.412217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:32.561819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:32.571092 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e5505aa2-250e-4c1b-bc0e-0f142f5052a8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.179946 Aug 11 16:53:32.571670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1290/2307] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:32 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:33.593324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:33.593967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:33.600582 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:33.601133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:33.601575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:33.602268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:33.602722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:33.603159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:33.732762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:33.741699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f3d62e30-859c-49e7-a973-6e9f61e228ce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152502 Aug 11 16:53:33.742250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1018/2308] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:53:34.762484 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:34.763087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:34.769441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:34.769915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:34.770350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:34.771022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:34.771623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:34.772044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:34.901699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:34.909516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c28092bd-d4ea-4fba-894d-dfd6219550ea tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150884 Aug 11 16:53:34.910069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1291/2309] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:35.931390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:35.932002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:35.934328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:35.939379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:35.939860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:35.940332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:35.941286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:35.941736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:35.942158 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:36.071996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:36.079965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e5acc11d-cba7-45dc-b701-6cd81962e697 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153049 Aug 11 16:53:36.080516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1019/2310] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:37.101190 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:37.101788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:37.108308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:37.108784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:37.109211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:37.109887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:37.110337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:37.110755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:37.240179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:37.248821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2d9533c-1b12-42bc-b369-c4987dec60de tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151738 Aug 11 16:53:37.249388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1292/2311] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:37 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:38.270009 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:38.270547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:38.277742 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:38.278218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:38.278646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:38.279326 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:38.279769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:38.280215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:38.410736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:38.418658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e5b02128-8314-44eb-9e41-88ef9e4164cb tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152624 Aug 11 16:53:38.419246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1020/2312] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:38 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:39.441030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:39.441558 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:39.448902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:39.449382 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:39.449815 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:39.450498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:39.450947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:39.451369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:39.581118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:39.590074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-790b902f-7fc0-47b3-8a7e-a1e831b09c7e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153394 Aug 11 16:53:39.590636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1293/2313] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:40.611730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:40.612388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:40.619497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:40.619967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:40.620417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:40.621099 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:40.621545 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:40.621964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:40.746942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:40.754747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c36683fc-5691-4162-8118-ea69c2f5b449 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.146852 Aug 11 16:53:40.755298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1021/2314] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:41.776445 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:41.777058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:41.783665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:41.784170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:41.784600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:41.785279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:41.785724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:41.786140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:41.914952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:41.924551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-26477e79-02e3-453b-b6df-06a1ea23cbaf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151878 Aug 11 16:53:41.925140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1294/2315] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:42.947305 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:42.947899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:42.955028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:42.955507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:42.955943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:42.956677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:42.957131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:42.957556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:42.960131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=94 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:43.089983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:43.097956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cc5d0e48-bc43-4fe4-9797-b23c2f6db191 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154558 Aug 11 16:53:43.098518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1022/2316] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:42 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:44.119642 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:44.120204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:44.127650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:44.128143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:44.128579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:44.129260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:44.129702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:44.130115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:44.260940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:44.269751 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4727cabd-7525-4675-ab5d-d39adf20d919 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154101 Aug 11 16:53:44.270307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1295/2317] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:44 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:45.291078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:45.291682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:45.298813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:45.299288 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:45.299717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:45.300430 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:45.300875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:45.301291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:45.431795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:45.440932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c2206b03-58e7-4156-95a1-82211a246270 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153477 Aug 11 16:53:45.441504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1023/2318] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:45 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:46.462345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:46.462994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:46.470368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:46.470841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:46.471266 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:46.471942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:46.472416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:46.472835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:46.476730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=78 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:53:46.601632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:46.609655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-487e818c-56cb-4428-85ea-a6d156d71f40 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151155 Aug 11 16:53:46.610225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1296/2319] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:47.631840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:47.632483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:47.639024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:47.639507 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:47.639943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:47.640668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:47.641122 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:47.641548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:47.770630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:47.778614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ddb546dd-e1e2-4edd-8810-bd0b7cd80380 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150665 Aug 11 16:53:47.779367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1024/2320] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:48.799507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:48.800126 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:48.806628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:48.807102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:48.807532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:48.808244 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:48.808686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:48.809152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:49.091901 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:49.100149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-32555093-e895-482a-aff9-0309a225bf6d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.304418 Aug 11 16:53:49.100708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1297/2321] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:50.121462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:50.122023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:50.128747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:50.129232 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:50.129668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:50.130357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:50.130811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:50.131239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:50.260894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:50.268994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a2744ca6-9d04-4c4c-bd91-a999d9e7dda1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151484 Aug 11 16:53:50.269556 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1025/2322] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:51.290430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:51.291015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:51.297599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:51.298076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:51.298538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:51.299205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:51.299655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:51.300070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:51.429304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:51.437264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2b899918-8fe7-4318-9702-c97b35840406 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150681 Aug 11 16:53:51.437820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1298/2323] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:51 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:52.459921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:52.460585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:52.467454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:52.467933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:52.468394 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:52.469083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:52.469537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:52.469962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:52.595044 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:52.603048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-72db8316-e53a-4bf7-b6b4-9c18969ef215 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147290 Aug 11 16:53:52.603609 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1026/2324] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:52 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:53.624011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:53.624673 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:53.631050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:53.631533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:53.631965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:53.632684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:53.633143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:53.633566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:53.759744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:53.768179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19132602-d594-4e05-9230-f22a5b7f8d1e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147992 Aug 11 16:53:53.768730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1299/2325] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:54.789739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:54.790350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:54.797082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:54.797592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:54.798022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:54.798766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:54.799262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:54.799681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:54.928892 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:54.937405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ee4c85dd-33c3-43b0-81eb-c91ca6787a46 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151569 Aug 11 16:53:54.937961 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1027/2326] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:55.958802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:55.959436 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:55.965867 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:55.966343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:55.966858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:55.967896 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:55.968504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:55.968949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:56.106251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:56.114950 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ca70ec68-5549-4dfe-a1ae-eccbcf77ac5f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.160050 Aug 11 16:53:56.115514 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1300/2327] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:57.135942 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:57.136572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:57.143599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:57.144068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:57.144524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:57.145205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:57.145646 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:57.146065 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:57.271192 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:57.279129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6a848e91-6465-4367-b5eb-852cfdcde4b0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147020 Aug 11 16:53:57.279748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1028/2328] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:58.300672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:58.301292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:58.307644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:58.308156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:58.308635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:58.309327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:58.309782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:58.310210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:58.438014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:58.446256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b01d9810-0359-41af-af40-e3dba6cd7f26 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149408 Aug 11 16:53:58.446809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1301/2329] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:58 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:53:59.468799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:53:59.469409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:53:59.475740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:59.476241 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:59.476677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:59.477383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:53:59.477827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:53:59.478243 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:53:59.607366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:53:59.615218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5d4cedf7-95c5-4896-adce-da72188b1f7f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151098 Aug 11 16:53:59.615777 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1029/2330] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:53:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:00.636400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:00.637009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:00.639596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:00.644875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:00.645352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:00.646238 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:00.646928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:00.647375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:00.648043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:00.780855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:00.789016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5548cc46-06e0-4a16-9d86-9c11ed944e36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156442 Aug 11 16:54:00.789561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1302/2331] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:01.809838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:01.810511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:01.817274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:01.817762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:01.818180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:01.818861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:01.819304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:01.819720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:01.951608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:01.959956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a605fc95-df4c-4c66-8655-efe2ff3e67da tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154084 Aug 11 16:54:01.960539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1030/2332] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:02.981631 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:02.982903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:02.989440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:02.989924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:02.990361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:02.991045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:02.991499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:02.991924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:03.120885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:03.129034 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-dabba052-1a72-4921-8b32-43addfe6d164 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151311 Aug 11 16:54:03.129605 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1303/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:04.150466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:04.151022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:04.157594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:04.158077 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:04.158516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:04.159212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:04.159667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:04.160118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:04.287770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:04.296443 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5d50f2ae-fdd6-432a-bf71-d0e53474c44c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149922 Aug 11 16:54:04.297004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1031/2334] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:05.317873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:05.318404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:05.324871 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:05.325343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:05.325771 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:05.327113 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:05.327555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:05.327972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:05.454550 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:05.462574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6fc6e85d-87ea-4b14-b504-726d0f8ed63f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148950 Aug 11 16:54:05.463129 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1304/2335] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:05 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:06.485076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:06.485688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:06.488000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=26 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:06.493401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:06.493890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:06.494324 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:06.495014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:06.495467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:06.495890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:06.626882 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:06.634863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-63723ea4-a19c-4a3c-a692-a0aad3646c06 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154431 Aug 11 16:54:06.635424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1032/2336] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:07.655659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:07.656307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:07.662756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:07.663267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:07.663702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:07.664415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:07.664864 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:07.665283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:07.795233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:07.803194 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ca128501-3feb-4076-86e3-8547e664dd8b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151401 Aug 11 16:54:07.803738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1305/2337] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:08.826296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:08.826962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:08.833762 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:08.834247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:08.834690 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:08.835383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:08.835837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:08.836301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:08.964456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:08.973385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-614b7ae8-e2ec-45b3-ad39-fd1dd24c1150 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151497 Aug 11 16:54:08.973982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1033/2338] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:09.994832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:09.995448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:10.001949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:10.002438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:10.002879 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:10.003565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:10.004020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:10.004471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:10.130557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:10.139049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c2d696e9-1ee2-4155-b8e6-4840e24a148f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147666 Aug 11 16:54:10.139606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1306/2339] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:11.160221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:11.160829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:11.167224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:11.167695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:11.168144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:11.168825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:11.169271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:11.169860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:11.297834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:11.305797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-77d4047e-c068-4fda-8c8b-91269e6efb4c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149450 Aug 11 16:54:11.306366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1034/2340] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:12.327762 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:12.328401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:12.334903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:12.335379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:12.335805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:12.336512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:12.336954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:12.337369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:12.466975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:12.474941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c45b8830-8da5-4510-9701-48855d53a6ad tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151707 Aug 11 16:54:12.475538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1307/2341] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:12 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:13.496677 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:13.497250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:13.504554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:13.505037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:13.505473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:13.506168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:13.506621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:13.507049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:13.511006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=78 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:13.639539 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:13.647459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-74a9d8bd-9372-4966-8561-3ea7d5b786c4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154775 Aug 11 16:54:13.648019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1035/2342] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:14.668180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:14.668789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:14.675424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:14.675910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:14.676392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:14.677088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:14.677548 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:14.677972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:14.806083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:14.814136 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b7314d5d-922c-4d5c-bfff-15fc4b4d1bd3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149775 Aug 11 16:54:14.814692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1308/2343] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:15.835626 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:15.836287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:15.843439 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:15.843912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:15.844362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:15.845130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:15.845481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:15.845899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:15.973100 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:15.981523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c410b48e-d6e6-46a7-8357-35ae152127f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149754 Aug 11 16:54:15.982738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1036/2344] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:17.003716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:17.004611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:17.010914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:17.011388 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:17.011818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:17.012517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:17.013231 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:17.013649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:17.016165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=78 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:17.146039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:17.153982 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ef6b75ea-0dee-4931-952b-668c2886185a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.154052 Aug 11 16:54:17.154532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1309/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:18.175361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:18.175958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:18.182483 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:18.182963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:18.183398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:18.184085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:18.184557 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:18.184980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:18.316454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:18.324316 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-22709492-c895-4306-a374-c9204db00306 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152945 Aug 11 16:54:18.324876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1037/2346] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:19.347635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:19.348304 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:19.355384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:19.355863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:19.356334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:19.357071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:19.357540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:19.357963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:19.488902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:19.496726 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e54e5616-6bde-4f17-8dae-66205c7673d5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153508 Aug 11 16:54:19.497270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1310/2347] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:19 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:20.519061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:20.520078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:20.527060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:20.527537 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:20.527971 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:20.528699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:20.530418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:20.530856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:20.658277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:20.666293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-af07b3bc-b9eb-4928-8cf0-97a0d7b79462 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151253 Aug 11 16:54:20.666858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1038/2348] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:21.688564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:21.689106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:21.695916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:21.696540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:21.696898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:21.697611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:21.698057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:21.698475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:21.824396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:21.832409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-47e48249-b83c-49e6-95dc-e02f4a1de015 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148418 Aug 11 16:54:21.832963 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1311/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:22.854191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:22.854807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:22.861328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:22.861809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:22.862245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:22.862941 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:22.863393 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:22.863819 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:22.994722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:23.003266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dd72a90c-f155-4478-bd4a-fd9789953b36 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152973 Aug 11 16:54:23.003825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1039/2350] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:24.024708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:24.025321 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:24.032453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:24.032975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:24.033415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:24.034135 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:24.034586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:24.035011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:24.167364 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:24.176417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9a206906-54b8-43b8-8e11-ca16df10541f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155604 Aug 11 16:54:24.176970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1312/2351] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:24 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:25.196994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:25.197611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:25.204118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:25.204608 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:25.205045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:25.205825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:25.206284 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:25.206707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:25.335224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:25.343983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c54c6097-2354-4527-983a-f632248ff2ae tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150926 Aug 11 16:54:25.344605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1040/2352] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:25 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:54:26.365305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:26.365941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:26.373032 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:26.373512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:26.373942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:26.374623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:26.375079 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:26.375498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:26.503187 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:26.511112 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d24aa34-25e3-46e8-9c6e-60b4298f4ff1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149664 Aug 11 16:54:26.511666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1313/2353] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:26 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:27.533653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:27.534215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:27.540035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:27.540534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:27.540960 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:27.541638 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:27.542087 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:27.542504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:27.674154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:27.682185 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f254f3a2-4d00-498e-96fc-c11175044716 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153809 Aug 11 16:54:27.682738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1041/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:27 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:28.704873 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:28.705491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:28.711431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:28.711914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:28.712391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:28.713076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:28.713540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:28.713965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:28.840301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:28.848298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c3bce437-167b-49c5-b0f8-b040d3ded78b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148357 Aug 11 16:54:28.848898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1314/2355] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:28 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:29.870752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:29.871407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:29.878494 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:29.878983 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:29.879420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:29.880128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:29.880591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:29.881017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:30.014093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:30.022018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-43efc3c6-a6b0-4469-ac0b-8eaf82443727 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155151 Aug 11 16:54:30.022621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1042/2356] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:29 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:31.043521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:31.044323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:31.046634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:31.052083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:31.052591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:31.053023 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:31.054029 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:31.054487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:31.054912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:31.190148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:31.199791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38966b6f-2906-4f0c-936a-96e3ddb153f2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.159605 Aug 11 16:54:31.200011 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1315/2357] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:31 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:32.222387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:32.222991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:32.229085 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:32.229559 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:32.229990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:32.230670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:32.231116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:32.231528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:32.358267 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:32.366105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6c7b7c12-7a05-4868-a505-7bf631127f05 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147604 Aug 11 16:54:32.366673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1043/2358] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:32 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:33.387324 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:33.389043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:33.396657 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:33.397134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:33.397561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:33.398242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:33.398695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:33.399111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:33.539606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:33.547958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4daae7b3-5a73-47f9-a1c4-4f8bf2279a42 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.164935 Aug 11 16:54:33.548554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1316/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:33 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:34.570197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:34.570812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:34.577482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:34.577958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:34.578398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:34.579093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:34.579547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:34.579974 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:34.711809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:34.720951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6ba9cba2-a132-46c0-9f4b-ff31c9aad977 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155009 Aug 11 16:54:34.721520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1044/2360] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:34 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:35.742207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:35.742812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:35.749412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:35.749924 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:35.750354 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:35.751028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:35.751474 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:35.751888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:35.882373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:35.891044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9ea54df3-1df8-447e-847c-f6da06793733 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152690 Aug 11 16:54:35.891598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1317/2361] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:35 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:36.912054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:36.912666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:36.915015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=26 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:36.920211 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:36.921225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:36.921851 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:36.922550 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:36.923004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:36.923429 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:37.050834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:37.059938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d529a5f7-0dd8-43fd-a3b7-bbab23d1ea73 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151763 Aug 11 16:54:37.060541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1045/2362] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:36 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:38.081987 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:38.082593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:38.089004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:38.089482 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:38.089915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:38.090597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:38.091046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:38.091469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:38.217176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:38.225164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d83b7707-4bf3-4d2a-8469-7f3bb07d2cf5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147818 Aug 11 16:54:38.225720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1318/2363] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:38 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:39.246286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:39.246905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:39.254275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:39.254770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:39.255210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:39.255901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:39.256386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:39.256814 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:39.391164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:39.399435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c6cfe7c9-9fa1-4b27-982d-29ec8d7fc87e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.157062 Aug 11 16:54:39.399998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1046/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:39 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:40.422424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:40.422951 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:40.429422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:40.429903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:40.430339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:40.431022 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:40.431476 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:40.431899 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:40.568709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:40.576648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ca312dde-b851-442c-9306-0c1cce75ba9f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.158688 Aug 11 16:54:40.577816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1319/2365] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:40 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:41.598541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:41.599152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:41.605632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:41.606102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:41.606533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:41.607207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:41.607650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:41.608066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:41.736428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:41.744280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d85d0c1b-6b4f-4f26-9e43-a6ccdeae7f96 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149566 Aug 11 16:54:41.744858 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1047/2366] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:41 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:42.766857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:42.767458 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:42.774115 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:42.774590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:42.775019 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:42.775690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:42.776318 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:42.776738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:42.904897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:42.913532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-37642abe-8494-4400-acbb-d2a04f04c4f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151222 Aug 11 16:54:42.914103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1320/2367] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:42 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:43.934752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:43.935381 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:43.942694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:43.943217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:43.943665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:43.944390 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:43.944843 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:43.945266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:43.949310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=78 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:44.073341 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:44.082005 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6adbb84d-07b7-44b1-b95c-f5029213afa2 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151144 Aug 11 16:54:44.082565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1048/2368] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:43 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:45.103752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:45.104392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:45.111439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:45.111918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:45.112391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:45.113102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:45.113553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:45.113972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:45.240616 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:45.248516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-651a66cb-48bd-459c-aaef-87c5f15fe48c tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148709 Aug 11 16:54:45.249623 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1321/2369] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:45 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:46.271283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:46.271844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:46.278274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:46.278756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:46.279187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:46.279877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:46.280455 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:46.280908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:46.410905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:46.418854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8cb74b0d-3448-4e3a-8d20-c3a2f64978f1 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151563 Aug 11 16:54:46.419418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1049/2370] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:46 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:47.441061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:47.441970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:47.448835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:47.449319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:47.449753 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:47.450439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:47.450890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:47.451310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:47.455911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=78 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:54:47.590467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:47.598784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a78865ab-d20b-4bbd-a078-afc5c0b137d7 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.161774 Aug 11 16:54:47.599350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1322/2371] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:47 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:48.620040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:48.620699 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:48.627795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:48.628311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:48.628741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:48.629420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:48.629862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:48.630278 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:48.756445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:48.764312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-309a0894-fc57-430a-a6a7-6466c3670399 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148125 Aug 11 16:54:48.764876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1050/2372] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:48 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:49.785793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:49.786356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:49.792835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:49.793314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:49.793744 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:49.794427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:49.794876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:49.795297 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:49.923664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:49.931529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6694f96b-687a-47a4-a49a-1dfc7196c14f tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150395 Aug 11 16:54:49.932110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1323/2373] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:49 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:50.953696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:50.954320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:50.960924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:50.961408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:50.961841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:50.962527 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:50.962978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:50.963412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:51.092554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:51.100900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c6f6d855-811f-41e1-9362-9d1e858304a3 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151397 Aug 11 16:54:51.101461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1051/2374] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:50 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:52.122198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:52.122752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:52.129738 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:52.130225 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:52.130663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:52.131347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:52.131798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:52.132256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:52.269855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:52.277791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c775880c-4b39-4b84-8377-98f31606692b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.159497 Aug 11 16:54:52.278362 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1324/2375] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:52 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:53.299206 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:53.299801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:53.306554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:53.306977 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:53.307410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:53.308116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:53.308576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:53.309006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:53.434844 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:53.443647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d39f5b65-ee0b-40ad-a116-40047c2931f5 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.148938 Aug 11 16:54:53.444234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1052/2376] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:53 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:54.465039 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:54.465630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:54.472775 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:54.473264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:54.473697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:54.474386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:54.474837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:54.475263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:54.605332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:54.613261 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-99919ce2-8291-4efe-8ef0-85beb32a60ed tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152373 Aug 11 16:54:54.613826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1325/2377] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:54 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:55.634319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:55.634930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:55.641398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:55.641841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:55.642271 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:55.642951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:55.643396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:55.643811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:55.772969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:55.780796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d471e14c-18e6-4e9f-b684-44d903ce0fce tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150329 Aug 11 16:54:55.781355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1053/2378] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:55 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:54:56.802611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:56.803243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:56.809655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:56.810130 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:56.810560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:56.811234 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:56.811682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:56.812125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:56.937248 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:56.946099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-817aa49d-48b7-40ab-bffd-1a440650f0cf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147457 Aug 11 16:54:56.946666 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1326/2379] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:56 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:54:57.967194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:57.967803 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:57.974982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:57.975464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:57.975928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:57.976648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:57.977096 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:57.977518 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:58.105949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:58.114893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4300f680-9dc7-4baa-b3af-72cdab0a7ee0 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151333 Aug 11 16:54:58.115426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1054/2380] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:57 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 16:54:59.136036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:54:59.136682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:54:59.143761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:59.144279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:59.144714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:59.145400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:54:59.145851 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:54:59.146272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:54:59.277915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:54:59.288615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22f95b77-7edd-4be4-b826-cc51d8076ee9 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.156536 Aug 11 16:54:59.289279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1327/2381] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:54:59 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:00.309566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:00.310171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:00.317205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:00.317674 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:00.318105 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:00.318808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:00.319254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:00.319666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:00.449704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:00.457884 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7e4c0800-1ced-4655-9c1d-777e39b68d07 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152166 Aug 11 16:55:00.458442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1055/2382] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:00 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:01.479938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:01.480723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:01.483062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:55:01.489084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:01.489569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:01.490014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:01.490850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:01.491320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:01.491747 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:01.621784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:01.630110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2fc34fea-9bb8-4f0d-83ae-f22ecbce3c84 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153987 Aug 11 16:55:01.630712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1328/2383] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:01 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:02.652177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:02.652787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:02.659370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:02.659848 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:02.660309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:02.661006 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:02.661452 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:02.661873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:03.028181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:03.036886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b43a613b-497e-4266-a06a-3aab50ee4258 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.388731 Aug 11 16:55:03.037448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1056/2384] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:02 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:04.057782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:04.058401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:04.065066 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:04.065545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:04.065973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:04.066906 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:04.067361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:04.067782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:04.199053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:04.207567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-38b45744-7b18-47bd-8120-6af654b1441e tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153611 Aug 11 16:55:04.208509 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1329/2385] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:04 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:05.229492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:05.230101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:05.236569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:05.237045 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:05.237478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:05.238152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:05.238599 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:05.239017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:05.364591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:05.372524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-78adaa7c-305f-46dc-b1b0-6b1160c13177 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147027 Aug 11 16:55:05.373097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1057/2386] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:05 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:06.395149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:06.395755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:06.402165 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:06.402638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:06.403064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:06.403736 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:06.404209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:06.404625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:06.533428 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:06.541287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b18b6bcc-7774-47be-b0fd-a497d37aa631 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.150556 Aug 11 16:55:06.541840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1330/2387] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:06 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:07.563505 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:07.564143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:07.566417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=26 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:55:07.571951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:07.572464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:07.572905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:07.573589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:07.574040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:07.574462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:07.706336 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:07.714226 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-83fc9889-4ba9-4813-9907-86bafe284ebf tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155225 Aug 11 16:55:07.714791 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1058/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:07 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:08.736391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:08.737031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:08.743791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:08.744312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:08.744748 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:08.745430 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:08.745883 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:08.746310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:08.877251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:08.885134 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a7c548b4-221a-485b-8347-2220610c712a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153191 Aug 11 16:55:08.885690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1331/2389] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:08 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:09.906782 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:09.908499 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:09.914901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:09.915383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:09.915817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:09.916531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:09.917079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:09.917432 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:10.050828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:10.058817 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-852bc3a4-8d55-4058-9c22-8834fef8b19a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155884 Aug 11 16:55:10.059410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1059/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:09 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:11.080796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:11.081404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:11.087912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:11.088418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:11.088850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:11.089527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:11.089973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:11.090391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:11.215604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:11.223752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2b523fd-03cd-468e-a971-e748f2e8eb9a tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.147583 Aug 11 16:55:11.224345 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1332/2391] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:11 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:12.245946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:12.246492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:12.253481 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:12.253959 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:12.254385 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:12.255057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:12.255500 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:12.255916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:12.389230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:12.397733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-346a0d2f-ae0a-4271-9f9f-a68c60743a70 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.155702 Aug 11 16:55:12.398299 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1060/2392] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:12 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:13.419233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:13.419791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:13.426852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:13.427337 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:13.427772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:13.428492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:13.428946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:13.429371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:13.554249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:13.562220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-51059ca4-3d4b-43a9-b163-0a40212d5b32 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.146921 Aug 11 16:55:13.562778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1333/2393] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:13 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:14.584389 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:14.584999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:14.591442 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:14.591921 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:14.592387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:14.593073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:14.593519 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:14.593938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:14.597015 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=78 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:55:14.722227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:14.730116 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bef4c5dd-e656-4baf-aea2-da1abdc97f02 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149624 Aug 11 16:55:14.730676 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1061/2394] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:14 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:15.751398 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:15.751978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:15.758371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:15.758852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:15.759275 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:15.759947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:15.760420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:15.760837 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:15.890817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:15.898819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3c4af9db-b8ce-44c1-8f42-3abe62f72a41 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.151949 Aug 11 16:55:15.899374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1334/2395] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:15 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:16.920072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:16.920706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:16.927300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:16.927774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:16.928230 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:16.928914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:16.929362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:16.929780 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:17.060310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:17.069383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7a58ed00-2551-4fcc-8ba1-da76dda54a6b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.153163 Aug 11 16:55:17.069950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1062/2396] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:16 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:18.089800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:18.090417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:18.097772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:18.098258 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:18.098699 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:18.099385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:18.099841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:18.100320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:18.102881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=78 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:55:18.229952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:18.238454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6c03c666-92e1-4d1b-a020-df5b966f409b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.152559 Aug 11 16:55:18.239006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1335/2397] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:18 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:19.260427 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:19.261033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:19.267444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:19.267916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:19.269202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:19.270102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:19.270558 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:19.270980 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:19.411340 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:19.419240 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-686a00c1-1216-410e-b8e8-a3a0e4384fd8 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.162851 Aug 11 16:55:19.419805 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1063/2398] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:19 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:20.442745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:20.443999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:20.450566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:20.451046 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:20.451480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:20.452195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:20.452648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:20.453069 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:20.589221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:20.601502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d980dd04-f9b3-477e-84a7-961e58f9ceb4 tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.164057 Aug 11 16:55:20.602076 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1336/2399] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:20 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:21.623223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:21.623878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:21.630688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:21.631174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:21.631611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:21.632400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:21.632854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:21.633280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:21.807411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:21.815438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e4cd7f98-7b7d-43c5-b24b-185bd4cc824b tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.196046 Aug 11 16:55:21.816000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1064/2400] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:21 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:55:22.837777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:55:22.838367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] [instance: 984554e8-81f8-42e6-b2a5-3067ea1b1ad0] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:55:22.846030 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:22.846510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:22.846946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:22.847627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:55:22.848078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:55:22.848525 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:55:22.975813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992a34be52b7491da0b68cbe17f25b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e71ba59c6d42dabeef49f62cebac1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 16:55:22.983756 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cdb2551d-ff79-4c6b-af79-f8ce3f070a5d tempest-VolumesSnapshotTestJSON-347925014 tempest-VolumesSnapshotTestJSON-347925014-project] 10.222.0.43 "GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0" status: 200 len: 1560 microversion: 2.1 time: 0.149858 Aug 11 16:55:22.984361 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1337/2401] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 16:55:22 2022] GET /compute/v2.1/servers/984554e8-81f8-42e6-b2a5-3067ea1b1ad0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 16:56:23.804628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:56:23.805365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:56:34.355333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:56:34.355990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:56:39.227878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:56:39.228448 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:58:32.663410 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:58:32.664282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:58:43.060072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:58:43.060589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:58:48.226695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:58:48.227208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:59:23.112934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a482159-06ce-4596-9945-1c0748148ed2] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 16:59:23.114347 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=13 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:59:23.115152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=23 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:59:23.120181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:59:23.120889 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:59:23.129465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:59:23.130219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:59:23.130808 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:59:23.132445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:59:23.132899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:59:23.133353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:59:23.148948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] HTTP exception thrown: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Request method failure captured: Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 HTTP/1.1 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4elzkBopKVyhdT-ecT9kZiXN2z2x65OT-S5Jr7VfBZ4ugiA8EUB0xBtVuA15B4Q5euI43ajP1ilS2adJb1Ynlg9m5xqoFU_KtXWYadEq4kVhmea8q89GYx7P1yd9AthCAoHO27S7R2PUSi5QGxuv_8gJ3FLkYoxpW_9yHlqsNFKGA Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 16:59:23.150648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa83645c0fed4133b9eaf4c67e2bbad8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}] Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 60ee85a52c0244879f10e8943d20dfb8 Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.152513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': '228fe15a-7159-4dbe-89fa-2340fc3c0558'} Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:59:23.153514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.155076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.158028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Returning 404 to user: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:59:23.158028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1280cc8f-802c-490f-864d-4394939f17ee tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 404 len: 111 microversion: 2.20 time: 0.040943 Aug 11 16:59:23.158028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1065/2402] 10.222.0.43 () {60 vars in 1280 bytes} [Thu Aug 11 16:59:23 2022] DELETE /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:59:23.158812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95ce555c-96ff-4903-b67c-16c5aeed6bc7] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 16:59:23.159626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=19 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:59:23.160486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=17 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 16:59:23.164892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 16:59:23.165513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] [instance: 228fe15a-7159-4dbe-89fa-2340fc3c0558] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 16:59:23.173099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:59:23.173594 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:59:23.174035 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:59:23.174737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 16:59:23.175412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 16:59:23.175915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 16:59:23.196461 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] HTTP exception thrown: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Request method failure captured: Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 HTTP/1.1 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4elzkBopKVyhdT-ecT9kZiXN2z2x65OT-S5Jr7VfBZ4ugiA8EUB0xBtVuA15B4Q5euI43ajP1ilS2adJb1Ynlg9m5xqoFU_KtXWYadEq4kVhmea8q89GYx7P1yd9AthCAoHO27S7R2PUSi5QGxuv_8gJ3FLkYoxpW_9yHlqsNFKGA Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 16:59:23.198026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fa83645c0fed4133b9eaf4c67e2bbad8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fa83645c0fed4133b9eaf4c67e2bbad8"}]}] Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: fa83645c0fed4133b9eaf4c67e2bbad8 Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1730888052 Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 60ee85a52c0244879f10e8943d20dfb8 Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1730888052-project Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.199634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '228fe15a-7159-4dbe-89fa-2340fc3c0558'} Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 16:59:23.200621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. Aug 11 16:59:23.202157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 16:59:23.203619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] Returning 404 to user: Instance 228fe15a-7159-4dbe-89fa-2340fc3c0558 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 16:59:23.203619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3f0e8c57-f008-4ec3-b682-9d2b572d4446 tempest-AttachVolumeShelveTestJSON-1730888052 tempest-AttachVolumeShelveTestJSON-1730888052-project] 10.222.0.43 "GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558" status: 404 len: 111 microversion: 2.20 time: 0.042618 Aug 11 16:59:23.203619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1338/2403] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Aug 11 16:59:23 2022] GET /compute/v2.1/servers/228fe15a-7159-4dbe-89fa-2340fc3c0558 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 16:59:43.812531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:59:43.813204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:59:54.363369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:59:54.363984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 16:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 16:59:59.235978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 16:59:59.236636 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 16:59:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:01:24.048898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:24.049958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:24.056193 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:24.057014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:24.066182 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:24.066728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:24.067166 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:24.067859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:24.068333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:24.068757 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:24.072657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a482159-06ce-4596-9945-1c0748148ed2] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51112. Aug 11 17:01:24.095376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 17:01:24.187487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-54f50f18-1e2f-4ed7-bb75-49fba5a1ad2e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 204 len: 0 microversion: 2.1 time: 0.141639 Aug 11 17:01:24.188488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1066/2404] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 17:01:24 2022] DELETE /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 17:01:24.195043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:24.196170 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:24.201196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:24.201817 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:24.220805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] [95ce555c-96ff-4903-b67c-16c5aeed6bc7] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 51122. Aug 11 17:01:24.224992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:24.225494 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:24.225934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:24.226643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:24.227098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:24.227523 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:24.503843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:24.512365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7f6842e4-39b0-44a7-a75d-2673e81bd3f7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1733 microversion: 2.1 time: 0.320016 Aug 11 17:01:24.512952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1339/2405] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1733 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:25.533894 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:25.534601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:25.541344 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:25.541828 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:25.542384 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:25.543090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:25.543535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:25.543953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:25.815854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:25.825294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4af903de-88ce-4461-b7e8-a69d01758068 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1665 microversion: 2.1 time: 0.295470 Aug 11 17:01:25.828308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1067/2406] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1665 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:25.954124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655956a1-b46b-46ea-9b5a-88a98e9618b6", "name": "network-vif-deleted", "tag": "8b1beaee-3a01-45dd-a658-c57feabad2e8"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:01:25.963763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:25.964840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:25.965249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:25.977372 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] Creating event network-vif-deleted:8b1beaee-3a01-45dd-a658-c57feabad2e8 for instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 on hv-cinder-85220 Aug 11 17:01:25.983627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-d032eedf-ebfc-49c5-bf02-f1ebc26d24e0 req-ca92b81d-4027-4735-81d4-c4155ed800c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109444 Aug 11 17:01:25.984255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1340/2407] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:01:26.846411 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:26.847066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:26.853414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:26.853922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:26.854360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:26.855624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:26.856081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:26.856531 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:26.924543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:26.932811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e4e8cc68-ec4c-4798-9015-3907e7f9146f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.090253 Aug 11 17:01:26.933530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1068/2408] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:27.954672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:27.955363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:27.961489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:27.961965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:27.962396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:27.963070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:27.963518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:27.964463 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:28.031021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:28.039552 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-987587eb-9c4e-4730-85af-4069a267700a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.089507 Aug 11 17:01:28.040140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1341/2409] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:01:29.060307 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:29.060950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:29.067335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:29.067816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:29.068283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:29.068965 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:29.069414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:29.069833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:29.135220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:29.144161 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-792d3836-5ad4-4604-933b-cc39d8186711 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.088053 Aug 11 17:01:29.144719 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1069/2410] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:30.165390 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:30.166001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:30.173662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:30.174146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:30.174579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:30.175265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:30.175716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:30.176169 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:30.240556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:30.248449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-228eb1b8-0a18-4613-ac87-8fd7a13591dc tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086883 Aug 11 17:01:30.249002 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1342/2411] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:31.269754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:31.270387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:31.277473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:31.277943 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:31.278376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:31.279050 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:31.279521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:31.279939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:31.340022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:31.347935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c8613eb1-a05d-4915-ad36-17b2bcd13bde tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082144 Aug 11 17:01:31.348521 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1070/2412] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:01:32.368295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:32.368846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:32.375182 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:32.375656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:32.376085 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:32.376780 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:32.377223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:32.377635 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:32.438452 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:32.446243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-861fe9b1-8bce-473f-8eb6-3d9b39ce3dba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.081913 Aug 11 17:01:32.446793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1343/2413] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:32 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:33.471254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:33.471809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:33.478212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:33.478693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:33.479126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:33.480075 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:33.480607 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:33.481031 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:33.541864 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:33.550156 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8ef112a5-22f9-4f37-92b4-0f89216acfb2 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086977 Aug 11 17:01:33.550710 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1071/2414] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:34.572449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:34.573920 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:34.580732 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:34.581216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:34.581651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:34.582340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:34.582794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:34.583219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:34.643634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:34.651559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8f4d4104-46d3-48ab-80f7-86a5d29ace1b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082960 Aug 11 17:01:34.652183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1344/2415] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:35.673217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:35.673810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:35.680541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:35.681191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:35.681768 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:35.683361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:35.683800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:35.684414 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:35.779373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:35.787498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ac0f8ec6-09d2-4de3-b664-7e7ad4b53464 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.118285 Aug 11 17:01:35.788062 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1072/2416] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:36.808570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:36.809173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:36.815701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:36.816206 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:36.816638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:36.817309 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:36.817755 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:36.818171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:36.883626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:36.891892 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af78e10c-dd8c-4afb-aa27-7184e638d0d4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087232 Aug 11 17:01:36.892488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1345/2417] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:37.912964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:37.913570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:37.920694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:37.921172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:37.921601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:37.922277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:37.922725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:37.923144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:37.983862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:37.991693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b4b6f65a-cb7d-4b7c-94a7-eae3ae982628 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082574 Aug 11 17:01:37.992277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1073/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:39.013819 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:39.014459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:39.020832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:39.021306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:39.021734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:39.022409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:39.022856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:39.023273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:39.084071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:39.092222 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a864b2e1-3138-45e3-9788-d81d0f853a0c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082840 Aug 11 17:01:39.092858 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1346/2419] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:40.112231 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:40.112840 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:40.119189 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:40.119662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:40.120218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:40.120978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:40.121422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:40.121839 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:40.185930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:40.193875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-81274070-f37e-4f8c-9638-529505c530aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085583 Aug 11 17:01:40.194441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1074/2420] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:41.215223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:41.215911 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:41.222576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:41.223063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:41.223488 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:41.224223 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:41.224668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:41.225093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:41.286723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:41.295438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-40deabd1-b96a-4716-a501-50aca2994e09 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084608 Aug 11 17:01:41.295990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1347/2421] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:42.315590 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:42.316175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:42.322693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:42.323503 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:42.323944 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:42.324832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:42.325287 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:42.325715 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:42.387478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:42.395412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a830dd29-b8c7-4567-a8cd-5f325308ee77 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083767 Aug 11 17:01:42.395968 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1075/2422] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:43.416492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:43.417122 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:43.423425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:43.423908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:43.424371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:43.425058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:43.425511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:43.425938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:43.488975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:43.497416 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22ad52fd-9ef6-4ff9-ad19-355bde906a06 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084912 Aug 11 17:01:43.497974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1348/2423] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:43 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:44.518080 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:44.518695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:44.525138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:44.525622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:44.526063 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:44.526753 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:44.527205 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:44.528173 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:44.592279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:44.600264 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6d68f56e-db47-4e56-bac5-ba77e4e183f1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086092 Aug 11 17:01:44.600823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1076/2424] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:45.620758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:45.621375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:45.627957 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:45.628502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:45.628941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:45.629626 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:45.630082 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:45.630529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:45.693393 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:45.702224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-54afa141-6a7f-45e1-bbc6-1e14562204e0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085332 Aug 11 17:01:45.702782 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1349/2425] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:46.723523 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:46.724079 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:46.730554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:46.731034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:46.731467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:46.732461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:46.732925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:46.733353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:46.793714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:46.801934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bf960413-0e76-4dfc-86dc-6130c40ed80d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082541 Aug 11 17:01:46.802497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1077/2426] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:47.822604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:47.823471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:47.830898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:47.831381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:47.831814 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:47.832530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:47.832988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:47.833412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:47.896580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:47.904889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0e3f2fc5-0a96-453c-bb00-e1031ab25aa9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086098 Aug 11 17:01:47.905459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1350/2427] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:48.925438 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:48.926112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:48.932532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:48.933014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:48.933451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:48.934133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:48.934585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:48.935239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:48.996458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:49.004923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4b736416-ac17-4e0d-a895-3ee780c9b96d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083331 Aug 11 17:01:49.005485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1078/2428] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:50.026236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:50.026847 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:50.034102 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:50.034581 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:50.035020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:50.035701 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:50.036178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:50.036602 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:50.098307 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:50.106396 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ac7cd17c-ab42-4c01-8fbf-0943e56bbb8e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084156 Aug 11 17:01:50.107593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1351/2429] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:51.127778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:51.128396 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:51.134760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:51.135236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:51.135667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:51.136378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:51.136822 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:51.137237 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:51.198919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:51.207678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a3606a93-ea07-40c0-a85f-21df29c5970f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083757 Aug 11 17:01:51.208274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1079/2430] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:52.228761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:52.229389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:52.236059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:52.236572 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:52.237007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:52.237692 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:52.238145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:52.238567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:52.300288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:52.308202 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4cf4e480-a3d3-4ed9-8009-58ee384ec0ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083228 Aug 11 17:01:52.308703 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1352/2431] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:53.330361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:53.330935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:53.337275 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:53.337751 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:53.338175 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:53.338846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:53.339291 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:53.339707 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:53.405314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:53.408854 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:53.413763 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-14797e89-bbdb-478d-912e-5cfefb9209aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087415 Aug 11 17:01:53.414332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1080/2432] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:54.434282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:54.435371 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:54.437367 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=29 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:54.442730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:54.443216 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:54.443654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:54.444375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:54.444832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:54.445257 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:54.447993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=81 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:54.509668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:54.518273 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b5492c85-b819-4c7f-ab0b-47974c28a84a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.088077 Aug 11 17:01:54.518833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1353/2433] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:54 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:55.539183 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:55.539739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:55.541930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:01:55.549263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:55.549807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:55.550250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:55.550947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:55.551400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:55.551833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:55.616915 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:55.625541 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5803407b-a986-40de-aa9e-55cc382b7932 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.090508 Aug 11 17:01:55.626097 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1081/2434] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:56.645903 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:56.646510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:56.653439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:56.653949 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:56.654386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:56.655078 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:56.655539 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:56.655967 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:56.716700 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:56.724442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b512d98c-9ea3-41af-829e-130d0b9c9382 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082347 Aug 11 17:01:56.725005 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1354/2435] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:57.745445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:57.746035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:57.752628 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:57.753111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:57.753552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:57.754238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:57.754691 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:57.755129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:57.815612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:57.823794 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c5c78aa3-f1b4-44ab-8aa0-c87c4e570feb tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082143 Aug 11 17:01:57.824409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1082/2436] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:58.845772 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:58.846369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:58.852804 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:58.853287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:58.853724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:58.854406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:58.854860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:58.855308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:58.918678 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:01:58.927294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-65d2febf-c02b-4955-9074-0a0b69e601a8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086239 Aug 11 17:01:58.927856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1355/2437] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:01:59.947836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:01:59.948736 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:01:59.955899 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:59.956451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:59.957168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:01:59.957852 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:01:59.958304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:01:59.958723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:00.020154 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:00.027986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b64635f8-36fb-4879-9054-fcab733dad7d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084024 Aug 11 17:02:00.029420 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1083/2438] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:01:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:01.049597 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:01.050260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:01.057245 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:01.057486 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:01.057913 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:01.058593 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:01.059040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:01.060036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:01.120702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:01.129542 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-df157edb-ac6b-4fd7-b3a2-4b932b2595d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083864 Aug 11 17:02:01.130100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1356/2439] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:02.150655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:02.151266 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:02.158795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:02.159274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:02.159712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:02.160423 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:02.160875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:02.161298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:02.226021 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:02.234479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a9e29923-9bd1-4665-a40f-0a7f1f06fe65 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087654 Aug 11 17:02:02.235047 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1084/2440] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:03.068958 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:02:03.069127 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:02:03.256017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:03.256639 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:03.263730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:03.264312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:03.264750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:03.265433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:03.265880 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:03.266299 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:03.330282 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:03.338050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9f0ff882-90b8-4ba8-98b3-fbdbc72e447e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086234 Aug 11 17:02:03.338598 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1357/2441] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:04.359453 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:04.360032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:04.366357 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:04.366827 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:04.367259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:04.367935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:04.368408 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:04.368857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:04.429737 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:04.437927 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-00a30ee1-b1d6-4c76-88dc-c9359e5a28ef tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083137 Aug 11 17:02:04.438492 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1085/2442] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:05.459812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:05.460414 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:05.466741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:05.467209 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:05.467634 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:05.468339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:05.468786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:05.469201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:05.531028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:05.538862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-334e9c58-96ed-48b2-b486-d3dbb480d9c3 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083502 Aug 11 17:02:05.539408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1358/2443] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:05 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:06.561007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:06.561635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:06.568008 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:06.568515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:06.568946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:06.569621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:06.570066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:06.570482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:06.631532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:06.639517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b16cff24-dd11-40d3-a92a-520316585bba tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083198 Aug 11 17:02:06.640073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1086/2444] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:07.660739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:07.661346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:07.667852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:07.668366 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:07.668844 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:07.669769 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:07.670224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:07.670650 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:07.731682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:07.739619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d77be606-2ba7-42bf-aa5c-51de2f008ebf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082791 Aug 11 17:02:07.740210 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1359/2445] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:08.760585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:08.761229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:08.768239 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:08.768724 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:08.769162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:08.769850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:08.770301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:08.770730 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:08.835969 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:08.844422 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-97ddf519-8acb-4e19-b9b2-b95e07de33a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087676 Aug 11 17:02:08.844978 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1087/2446] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:09.864940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:09.865556 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:09.872671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:09.873162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:09.873599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:09.874286 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:09.874737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:09.875161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:09.937214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:09.945093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a36a999a-0b60-40d9-9f3c-4990bf68b92d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084018 Aug 11 17:02:09.945645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1360/2447] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:10.967728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:10.968364 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:10.974740 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:10.975219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:10.975653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:10.976366 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:10.976816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:10.977238 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:11.040535 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:11.049335 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-60114fbb-8fb4-4cf0-8733-21ed2ce0ae70 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086399 Aug 11 17:02:11.049902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1088/2448] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:12.070185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:12.070821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:12.077533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:12.078010 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:12.078439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:12.079118 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:12.079564 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:12.079981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:12.143529 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:12.151322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0f182849-87bf-47e7-a8a6-7c436b5b1344 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084980 Aug 11 17:02:12.151878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1361/2449] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:13.172661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:13.173273 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:13.179654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:13.180152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:13.180589 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:13.181269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:13.181718 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:13.182144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:13.246303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:13.254829 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-99dc7a9d-d33e-49bc-a70a-5fe97e356563 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087065 Aug 11 17:02:13.255388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1089/2450] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:14.275298 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:14.275933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:14.282663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:14.283137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:14.283565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:14.284292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:14.284739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:14.285157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:14.347915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:14.355816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e66ca3ac-a7bb-402c-9ace-fadabf642d7f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084327 Aug 11 17:02:14.356876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1362/2451] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:14 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:15.378072 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:15.378601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:15.385012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:15.385496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:15.385930 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:15.386610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:15.387059 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:15.388092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:15.449369 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:15.458605 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-132d0b17-fd9d-4d57-ab64-24cd93a16fb0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084412 Aug 11 17:02:15.459178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1090/2452] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:15 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:16.478878 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:16.479437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:16.485986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:16.486471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:16.486910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:16.487595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:16.488050 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:16.488501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:16.550083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:16.558049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-fbfc5145-1db5-4255-a113-d7f98b0e0ed0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083157 Aug 11 17:02:16.558612 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1363/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:16 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:17.578401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:17.578986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:17.585996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:17.586480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:17.586922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:17.587611 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:17.588069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:17.588520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:17.651327 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:17.660027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a525d7f9-2b2a-46ee-9cc9-31ea3292b4da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085931 Aug 11 17:02:17.660637 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1091/2454] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:17 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:18.681174 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:18.681784 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:18.688956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:18.689431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:18.689861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:18.690536 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:18.690980 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:18.691397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:18.754500 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:18.762770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3fcf733f-516f-41d8-bb8f-ad74014129a5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085096 Aug 11 17:02:18.763492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1364/2455] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:18 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:19.783649 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:19.784295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:19.790900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:19.791378 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:19.791811 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:19.792538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:19.792990 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:19.793501 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:19.858407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:19.866349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-97f66e1b-7d29-4d69-8d7b-b3a44cb3b178 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086957 Aug 11 17:02:19.866913 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1092/2456] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:19 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:20.887058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:20.887940 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:20.894422 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:20.894912 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:20.895353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:20.896042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:20.896535 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:20.896960 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:20.960493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:20.968492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-022d7ac8-616f-46c6-bbf3-da7e59b02320 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085280 Aug 11 17:02:20.969058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1365/2457] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:20 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:21.989585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:21.990198 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:21.997174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:21.997650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:21.998082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:21.998770 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:21.999221 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:21.999645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:22.060682 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:22.068623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-99e40481-5707-4a7d-a911-49084016bd0d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082929 Aug 11 17:02:22.069191 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1093/2458] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:21 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:23.089467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:23.090101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:23.096992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:23.097469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:23.097898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:23.098570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:23.099018 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:23.099433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:23.160378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:23.168183 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-69ccca81-70a7-4c87-b567-2cf06a0a3755 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082565 Aug 11 17:02:23.168830 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1366/2459] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:23 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:24.189362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:24.189966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:24.196012 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:24.196511 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:24.196939 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:24.197616 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:24.198061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:24.198480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:24.260771 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:24.270024 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-344f2976-3c44-4562-a1a0-37a4124d29da tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084164 Aug 11 17:02:24.271054 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1094/2460] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:24 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:25.291714 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:25.292339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:25.294197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:25.299827 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:25.300336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:25.300764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:25.301437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:25.301885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:25.302300 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:25.306421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:25.363764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:25.371519 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-180d1398-72ad-47d2-a252-c3f42b7cd419 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083890 Aug 11 17:02:25.372068 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1367/2461] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:25 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:26.393119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:26.393666 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:26.396051 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=28 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:26.401508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:26.401991 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:26.402428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:26.403121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:26.403581 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:26.404629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:26.407409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=85 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:26.467764 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:26.475732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b9daee81-88e7-4545-a179-01bf9751c6d5 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086728 Aug 11 17:02:26.476334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1095/2462] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:26 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:27.496862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:27.497520 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:27.504590 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:27.505070 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:27.505501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:27.506184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:27.506636 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:27.507058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:27.569140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:27.577887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2e0c4386-4b55-48ac-9afe-4769b1383006 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084950 Aug 11 17:02:27.578448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1368/2463] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:27 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:28.598362 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:28.598994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:28.605433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:28.605909 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:28.606342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:28.607553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:28.607998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:28.608445 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:28.671993 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:28.679928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cff724fc-079b-4240-aadf-eea62d1498aa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085485 Aug 11 17:02:28.680532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1096/2464] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:28 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:29.701278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:29.701893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:29.709137 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:29.709621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:29.710058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:29.710742 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:29.711192 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:29.711613 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:29.776288 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:29.784760 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2ee0a4ca-e045-47c2-850b-e51f5339192e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087574 Aug 11 17:02:29.785320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1369/2465] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:29 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:30.805048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:30.805653 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:30.812090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:30.812769 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:30.813222 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:30.813902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:30.814346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:30.814760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:30.876208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:30.884082 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1050a815-fb39-4918-bda2-e90a5c446baa tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082885 Aug 11 17:02:30.884665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1097/2466] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:30 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:31.905105 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:31.905720 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:31.912347 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:31.912834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:31.913269 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:31.913959 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:31.914413 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:31.914840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:31.976483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:31.984789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1a8b80f7-6cda-41f0-a5a8-52c8a29622dd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083469 Aug 11 17:02:31.985292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1370/2467] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:31 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:33.005371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:33.005966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:33.012342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:33.012818 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:33.013252 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:33.013933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:33.014383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:33.014799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:33.076951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:33.085360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c1d31bd0-2eeb-4772-8857-66cae8be38be tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083857 Aug 11 17:02:33.085918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1098/2468] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:33 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:34.106750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:34.107365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:34.114530 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:34.115014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:34.115451 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:34.116161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:34.116621 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:34.117045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:34.178348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:34.186173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-53d882d9-1434-4388-8787-2bd583c7f9d7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083286 Aug 11 17:02:34.186729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1371/2469] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:34 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:35.206540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:35.207152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:35.213645 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:35.214117 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:35.214546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:35.215225 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:35.215669 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:35.216088 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:35.277334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:35.285228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-739cd0d5-d358-4ef0-96b3-543a4dd76a52 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082617 Aug 11 17:02:35.285793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1099/2470] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:35 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:02:36.306233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:36.307064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:36.314251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:36.314730 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:36.315164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:36.315850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:36.316339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:36.316764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:36.380799 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:36.388625 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-9b2ea8be-68ad-494a-83f3-2bbcc3a572d0 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086339 Aug 11 17:02:36.389185 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1372/2471] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:36 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:37.410130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:37.410679 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:37.417007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:37.417478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:37.417905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:37.418578 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:37.419022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:37.419441 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:37.489003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:37.497334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-037d5ac7-c8ad-4d26-9953-bac81602eb2b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.091860 Aug 11 17:02:37.497963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1100/2472] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:37 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:38.519074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:38.519624 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:38.526083 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:38.526565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:38.527001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:38.527684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:38.528154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:38.528579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:38.592263 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:38.600983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-320d4f04-1c3e-43b4-a202-c7d3191b03d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.086092 Aug 11 17:02:38.601538 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1373/2473] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:38 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:39.622300 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:39.622910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:39.630723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:39.631200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:39.631639 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:39.632360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:39.632810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:39.633236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:39.695479 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:39.703970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8fb65e50-ae0f-44b9-8916-5a7d1fdb4f89 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085492 Aug 11 17:02:39.704563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1101/2474] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:39 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:40.725351 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:40.725965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:40.732599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:40.733088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:40.733528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:40.734218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:40.735555 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:40.735992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:40.795340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:40.803818 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-97e78a69-9552-4c11-930b-72579afb525d tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082472 Aug 11 17:02:40.804419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1374/2475] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:40 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:02:41.825731 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:41.826333 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:41.833793 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:41.834274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:41.834708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:41.835644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:41.836114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:41.836569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:41.906565 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:41.914712 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c0b24d57-1c34-4d75-8956-b10e6cf90aa8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.093590 Aug 11 17:02:41.915282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1102/2476] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:41 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:42.936551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:42.937150 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:42.944249 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:42.944731 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:42.945168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:42.945855 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:42.946308 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:42.946729 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:43.009752 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:43.018516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-60d6bb3b-01f1-4f47-afcb-01a4c0456595 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085800 Aug 11 17:02:43.019077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1375/2477] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:42 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:44.038860 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:44.039456 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:44.045911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:44.046388 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:44.046820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:44.047893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:44.048367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:44.048789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:44.111457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:44.119383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e462488f-e2cb-4a73-949d-06ef516c2c32 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084466 Aug 11 17:02:44.119953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1103/2478] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:44 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:45.140166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:45.140776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:45.147214 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:45.147695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:45.148149 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:45.148835 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:45.149283 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:45.149707 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:45.211801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:45.220708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7373b2db-e8a9-4f0b-aa60-dd14aa3e4184 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084427 Aug 11 17:02:45.221267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1376/2479] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:45 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:46.241766 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:46.242379 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:46.248842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:46.249323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:46.249759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:46.250444 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:46.251567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:46.252081 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:46.317058 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:46.325571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3d65bfba-ecb0-4711-bcf1-5d0bb7bf54ea tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.087683 Aug 11 17:02:46.326144 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1104/2480] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:46 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:47.348400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:47.349028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:47.355582 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:47.356087 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:47.356540 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:47.357221 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:47.357667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:47.358084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:47.429454 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:47.437840 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d2903440-deb7-4c35-8669-3b60c4f12a9b tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.095130 Aug 11 17:02:47.439247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1377/2481] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:47 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:48.459951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:48.460575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:48.467037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:48.467516 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:48.467950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:48.468660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:48.469110 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:48.469735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:48.532143 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:48.542125 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-61b1304a-5af1-4de0-94fa-ee241a7932f4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085993 Aug 11 17:02:48.542695 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1105/2482] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:48 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:49.566789 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:49.567394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:49.574047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:49.574778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:49.575208 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:49.575888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:49.576374 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:49.576795 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:49.639559 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:49.648412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bcc6045f-c9bc-4f59-ac5f-01bbdf597b02 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085496 Aug 11 17:02:49.648972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1378/2483] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:49 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:50.668069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:50.668748 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:50.675926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:50.676446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:50.676887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:50.677585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:50.678038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:50.678466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:50.740592 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:50.748681 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7a9bdc81-0a09-469c-b021-468856902634 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084470 Aug 11 17:02:50.749248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1106/2484] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:50 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:51.769973 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:51.770574 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:51.777043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:51.777512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:51.777939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:51.778608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:51.779051 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:51.779465 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:51.839996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:51.847996 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6941f2b7-afc5-40c2-a772-71ce1df1c95a tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.082123 Aug 11 17:02:51.848603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1379/2485] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:51 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:52.869433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:52.870040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:52.876668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:52.877152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:52.877591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:52.878283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:52.878739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:52.879168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:52.943199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:52.951350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b70581c5-a6a1-4521-aefc-aa8c99f8b1d8 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085799 Aug 11 17:02:52.951910 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1107/2486] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:52 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:53.972384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:53.972974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:53.979376 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:53.979850 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:53.980320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:53.981021 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:53.981467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:53.981885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:54.043205 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:54.051586 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3efabcdc-64d0-40e7-a608-518fe9110e3c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083175 Aug 11 17:02:54.052178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1380/2487] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:53 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:55.071879 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:55.072529 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:55.079359 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:55.079837 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:55.080311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:55.080999 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:55.081458 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:55.081874 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:55.145515 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:55.153370 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0992ad1a-f66d-4e5d-ab8e-ba2a31457421 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085329 Aug 11 17:02:55.153932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1108/2488] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:55 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:56.175668 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:56.176312 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:56.178328 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=28 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:56.183909 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:56.184437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:56.184881 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:56.185577 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:56.186033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:56.186460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:56.190157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=84 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:56.253167 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:56.261098 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85c7273c-a39d-40df-aa6c-35a852fdd4e9 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.090047 Aug 11 17:02:56.261660 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1381/2489] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:56 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:57.281722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:57.282355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:57.284825 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=28 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:57.290113 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:57.290587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:57.291017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:57.291694 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:57.292165 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:57.292585 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:57.295263 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=84 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:02:57.355504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:57.363475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3b984467-d232-47c1-a099-fb85a83f42a7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085755 Aug 11 17:02:57.364040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1109/2490] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:57 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:58.383813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:58.384394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:58.390852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:58.391331 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:58.391768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:58.392475 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:58.393262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:58.393513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:58.456471 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:58.464276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b21ba65a-449c-4597-9479-ba2129956727 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084447 Aug 11 17:02:58.464832 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1382/2491] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:58 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:02:59.485019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:02:59.485621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:02:59.492870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:59.493355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:59.493795 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:59.494480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:02:59.494934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:02:59.495361 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:02:59.556265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:02:59.564250 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4825d46d-41d5-4414-8c96-26363baacc59 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083171 Aug 11 17:02:59.564862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1110/2492] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:02:59 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:00.586576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:00.587188 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:00.593677 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:00.594156 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:00.594588 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:00.595265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:00.595721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:00.596739 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:00.657003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:00.665694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-88291d26-2431-49e8-b844-322330e7a735 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083096 Aug 11 17:03:00.666255 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1383/2493] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:00 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:01.687386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:01.687950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:01.694953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:01.695424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:01.695853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:01.696621 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:01.697068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:01.697487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:01.759020 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:01.766902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0596e22-3f17-4fa5-8f39-2a2027a7ac23 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083544 Aug 11 17:03:01.767464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1111/2494] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:01 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:02.787712 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:02.788340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:02.794860 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:02.795334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:02.795764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:02.796477 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:02.796926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:02.797346 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:02.858884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:02.867569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-592de22c-d0bf-4597-ac46-ff0479e8c2d1 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.084217 Aug 11 17:03:02.868142 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1384/2495] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:02 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:03.820164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:03:03.820984 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:03:03.887778 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:03.888407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:03.895661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:03.896172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:03.896789 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:03.897703 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:03.897949 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:03.898367 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:03.965657 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:03.974129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a1692705-35df-4710-bdc8-aaef43455c20 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.090275 Aug 11 17:03:03.974665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1112/2496] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:03 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:04.994651 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:04.995279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:05.001715 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:05.002808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:05.003260 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:05.003943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:05.004423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:05.004843 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:05.068004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:05.076189 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-0c3e9bcb-fd54-47bb-b247-c5f3f10e52fd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085382 Aug 11 17:03:05.076741 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1385/2497] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:04 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:06.097412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:06.098022 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:06.104617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:06.105093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:06.105525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:06.106207 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:06.106658 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:06.107073 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:06.168003 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:06.176525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bf1f0b5c-1fab-4668-82a0-8ed54fb53347 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083342 Aug 11 17:03:06.177092 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1113/2498] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:06 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:07.198438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:07.199045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:07.205861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:07.206342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:07.206774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:07.207459 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:07.207910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:07.208360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:07.268332 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:07.276141 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aaad35bc-1742-42c2-b666-539fc08224bd tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.081557 Aug 11 17:03:07.276708 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1386/2499] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:07 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:08.296956 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:08.297566 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:08.304859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:08.305339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:08.305772 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:08.306504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:08.306902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:08.307320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:08.370405 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:08.378688 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-6090a25c-b568-463a-87c7-55463f3ccfb7 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085585 Aug 11 17:03:08.379253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1114/2500] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:08 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:09.399268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:09.399884 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:09.406303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:09.406785 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:09.407219 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:09.407907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:09.408392 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:09.409719 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:09.472894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:09.481100 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-4d89ae8e-2a50-4b42-ba4a-d9607d678622 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.085755 Aug 11 17:03:09.481658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1387/2501] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:09 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:10.501617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:10.502261 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:10.508689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:10.509174 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:10.509615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:10.510309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:10.510760 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:10.511187 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:10.572947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:10.581234 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-32016dca-eeb8-4d2c-8bad-1295b179733e tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083715 Aug 11 17:03:10.581807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1115/2502] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:10 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:03:11.602296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:11.602941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:11.609667 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:11.610173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:11.610603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:11.611281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:11.612439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:11.612888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:11.674121 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:11.681910 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cb72ee15-71c7-4e25-86ab-aa7eab4a0c0f tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1374 microversion: 2.1 time: 0.083474 Aug 11 17:03:11.682511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1388/2503] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:11 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1374 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:12.703872 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:12.705787 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:12.716857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:12.718528 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:12.719037 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:12.720538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:12.721997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:12.722725 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:12.760413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:12.760901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:12.761342 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:12.761989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'fault' on Instance uuid 655956a1-b46b-46ea-9b5a-88a98e9618b6 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:03:12.813007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:12.821625 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-e67ef194-1ede-4f92-b289-8b91e744879c tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 200 len: 1468 microversion: 2.1 time: 0.122634 Aug 11 17:03:12.822200 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1116/2504] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:12 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 1468 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:13.842603 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:13.843197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: 655956a1-b46b-46ea-9b5a-88a98e9618b6] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:13.849988 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:13.850460 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:13.850891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:13.851567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:13.852012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:13.852457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:13.868295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 HTTP/1.1 Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 17:03:13.869904 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. Aug 11 17:03:13.871723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '655956a1-b46b-46ea-9b5a-88a98e9618b6'} Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:03:13.872809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. Aug 11 17:03:13.874553 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:13.876084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 404 to user: Instance 655956a1-b46b-46ea-9b5a-88a98e9618b6 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:03:13.876084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b386efe-26bc-42f8-be14-81e3dba6a036 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6" status: 404 len: 111 microversion: 2.1 time: 0.032486 Aug 11 17:03:13.876084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1389/2505] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:13 2022] GET /compute/v2.1/servers/655956a1-b46b-46ea-9b5a-88a98e9618b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:03:13.880861 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-294784e3-35c7-454f-8922-0b760fcfb587 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '.version_select at 0x7f6143e35af0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:13.904349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-294784e3-35c7-454f-8922-0b760fcfb587 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838272877" status: 202 len: 0 microversion: 2.1 time: 0.028215 Aug 11 17:03:13.904916 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1117/2506] 10.222.0.43 () {58 vars in 1218 bytes} [Thu Aug 11 17:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838272877 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:03:14.371820 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:03:14.372003 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:03:14.704462 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984554e8-81f8-42e6-b2a5-3067ea1b1ad0", "name": "network-vif-deleted", "tag": "734bce4d-4e8a-40aa-8c54-787cf874a86c"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:03:14.715101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:14.715571 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:14.715993 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:14.726978 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] Creating event network-vif-deleted:734bce4d-4e8a-40aa-8c54-787cf874a86c for instance 984554e8-81f8-42e6-b2a5-3067ea1b1ad0 on hv-cinder-85220 Aug 11 17:03:14.732254 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-96a83f7d-924e-4a87-a9ab-423e5aef799c req-7cfa4a31-ee65-479c-82f4-285ee862980c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Aug 11 17:03:14.732821 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1390/2507] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:03:19.244809 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:03:19.245349 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:03:24.214392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:24.215631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:24.218922 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=49 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:24.220295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:24.230812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:24.231632 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:24.232488 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:24.233440 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:24.234069 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:24.234561 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:24.264464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 17:03:24.363908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-370f806d-db88-4e42-95d0-4edcc76e3979 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 204 len: 0 microversion: 2.1 time: 0.154542 Aug 11 17:03:24.367833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1118/2508] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 17:03:24 2022] DELETE /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 17:03:24.374386 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:24.375173 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:24.383531 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:24.384166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:24.384793 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:24.385489 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:24.385941 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:24.386491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:24.541496 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:24.549389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d3975662-03a6-462c-b473-081a0179c468 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1508 microversion: 2.1 time: 0.179922 Aug 11 17:03:24.550040 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1391/2509] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:24 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:25.372775 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cff93e-cea6-4a7e-92ce-c2f0990edc7e", "name": "network-vif-deleted", "tag": "815de520-05d9-494f-9457-2930d19312ed"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:03:25.386833 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:25.387404 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:25.387932 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:25.402146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] Creating event network-vif-deleted:815de520-05d9-494f-9457-2930d19312ed for instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e on hv-cinder-85220 Aug 11 17:03:25.409462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-3c2e6ca8-c8d7-4ac5-9b93-707ed00415e3 req-487562bc-80c9-4af9-9925-be09fa200d5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040730 Aug 11 17:03:25.410784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1119/2510] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:03:25.572557 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:25.573171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:25.580891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:25.581424 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:25.581966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:25.582675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:25.583138 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:25.583570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:25.616407 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:25.617147 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:25.617954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:25.618596 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'fault' on Instance uuid d9cff93e-cea6-4a7e-92ce-c2f0990edc7e {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:03:25.680511 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:25.692360 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c8171fa3-14f8-4850-8600-ce8bdcbe7688 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 200 len: 1312 microversion: 2.1 time: 0.123467 Aug 11 17:03:25.693409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1392/2511] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:25 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:26.719641 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:26.720368 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: d9cff93e-cea6-4a7e-92ce-c2f0990edc7e] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:26.726845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.727319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.727752 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:26.728464 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.728908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.729330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:26.744055 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.wsgi [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: request: GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e HTTP/1.1 Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept: application/json Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Accept-Encoding: identity Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Connection: close Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Length: 0 Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Content-Type: application/json Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Host: 10.222.0.43 Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Openstack-System-Scope: None Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: User-Agent: python-urllib3/1.26.11 Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Id: None Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Domain-Name: None Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Identity-Status: Confirmed Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Is-Admin-Project: True Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Id: default Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Domain-Name: Default Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Role: reader,member Aug 11 17:03:26.746141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Roles: reader,member Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Id: default Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Domain-Name: Default Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: method: > Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: exception: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. Aug 11 17:03:26.748017 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: action_args: {'id': 'd9cff93e-cea6-4a7e-92ce-c2f0990edc7e'} Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:03:26.749101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. Aug 11 17:03:26.750744 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR nova.api.openstack.wsgi Aug 11 17:03:26.753406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 404 to user: Instance d9cff93e-cea6-4a7e-92ce-c2f0990edc7e could not be found. {{(pid=120730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:03:26.753406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-2dc1dc4d-5c44-454b-a14e-0c06d6c21e84 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e" status: 404 len: 111 microversion: 2.1 time: 0.035844 Aug 11 17:03:26.753406 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1120/2512] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:26 2022] GET /compute/v2.1/servers/d9cff93e-cea6-4a7e-92ce-c2f0990edc7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:03:26.759983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:26.760532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:26.763682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:26.769450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.769943 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.770384 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:26.771084 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.771721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.772363 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:26.776653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=66 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:26.800680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Going to try to terminate instance {{(pid=120731) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 17:03:26.884568 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-84a2bf89-14c8-48d4-a26c-62a010586aaf tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 204 len: 0 microversion: 2.1 time: 0.128089 Aug 11 17:03:26.885389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1393/2513] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 17:03:26 2022] DELETE /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 17:03:26.894048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:26.894823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:26.901532 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.902303 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.902738 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:26.903424 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:26.903920 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:26.904371 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:27.048348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:27.059797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-b9371b83-4307-4eb5-a1d8-87889df05000 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1522 microversion: 2.1 time: 0.170195 Aug 11 17:03:27.060745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1121/2514] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:26 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:03:27.968808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad28131-4298-4448-bdb8-74313c3bf525", "name": "network-vif-deleted", "tag": "d092b0e0-4c57-4a25-b642-5a3ba8e66bf6"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:03:27.980009 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:27.980831 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:27.981270 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:27.994447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] Creating event network-vif-deleted:d092b0e0-4c57-4a25-b642-5a3ba8e66bf6 for instance aad28131-4298-4448-bdb8-74313c3bf525 on hv-cinder-85220 Aug 11 17:03:28.000265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-da835c53-4d53-4a07-b8c9-3a4d5a0d09aa req-688884fc-b1ae-42a1-bdde-a10ade6bd36e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036270 Aug 11 17:03:28.001116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1394/2515] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:03:28.083312 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:28.083987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:28.090734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:28.091268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:28.091683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:28.092415 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:28.092870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:28.093317 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:28.127987 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:28.128508 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:28.128950 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:28.129403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lazy-loading 'fault' on Instance uuid aad28131-4298-4448-bdb8-74313c3bf525 {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:03:28.181093 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d59680b3fde47bf81c7765ca4d8a757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ea665a47e44438aa8c4a9e763c78fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:03:28.188800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-7121fa71-162b-4f0c-8699-61cee1302ce4 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 200 len: 1312 microversion: 2.1 time: 0.110075 Aug 11 17:03:28.189747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1122/2516] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:28 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:03:29.218515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:03:29.219369 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] [instance: aad28131-4298-4448-bdb8-74313c3bf525] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:03:29.225933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:29.226491 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:29.227116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:29.227875 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:03:29.228425 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:03:29.228929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:03:29.244902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] HTTP exception thrown: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Request method failure captured: Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 HTTP/1.1 Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9S4eXfVcmZr5yQf-3QhpH-EJPiBZYEH-VMdTGMWLF8bwOkhwetNiHaZgl_gmxX40-57w_iYVGXjXRS_95F0cTj5G0Yu57xS6dGZcr-Bqpp7-aEY0KMJMAjv3_pGgusTzP2JlTzNaPgZbkoUXvN9PapSjiOTgiQecpAtEhkY9Sq9K6kU Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 17:03:29.246999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ea665a47e44438aa8c4a9e763c78fdd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ea665a47e44438aa8c4a9e763c78fdd"}]}] Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 0ea665a47e44438aa8c4a9e763c78fdd Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1668002397 Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 5d59680b3fde47bf81c7765ca4d8a757 Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1668002397-project Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. Aug 11 17:03:29.248846 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': 'aad28131-4298-4448-bdb8-74313c3bf525'} Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:03:29.250017 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. Aug 11 17:03:29.251664 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:03:29.254199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] Returning 404 to user: Instance aad28131-4298-4448-bdb8-74313c3bf525 could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:03:29.254199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5cb8ced3-3cfb-468a-8bab-d736a47a9c91 tempest-ServerRescueNegativeTestJSON-1668002397 tempest-ServerRescueNegativeTestJSON-1668002397-project] 10.222.0.43 "GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525" status: 404 len: 111 microversion: 2.1 time: 0.035407 Aug 11 17:03:29.254199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1395/2517] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:03:29 2022] GET /compute/v2.1/servers/aad28131-4298-4448-bdb8-74313c3bf525 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:03:59.429571 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-92c8f867-650c-4ec7-834b-caaff9d1eb1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'create', calling method: .version_select at 0x7f6143413550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2062842515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwdV4IeyBksvcwKROXMCy2onQSeWHMoFz8cSegcrjAR2bYF5/BvLSc+AdEsrgOq+YIXRu5LVV2kfLf5+jK0P3Y9SjHbCybMb75U6f7iEH2CWuuM8jpCto1FtdWOc4F6MQ=="}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:03:59.435224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:59.435887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:59.450294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-92c8f867-650c-4ec7-834b-caaff9d1eb1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Getting quotas for project 7cfc50ac33174447af8f4a7ecc6cc125. Resources: {'key_pairs'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 17:03:59.455036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-92c8f867-650c-4ec7-834b-caaff9d1eb1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Getting quotas for user 4f62872ebbfd471b9db50bcc401a1768 and project 7cfc50ac33174447af8f4a7ecc6cc125. Resources: {'key_pairs'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 17:03:59.477834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-92c8f867-650c-4ec7-834b-caaff9d1eb1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052446 Aug 11 17:03:59.478779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1123/2518] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 17:03:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:03:59.592975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1118255605", "imageRef": "617be961-f4fa-42c9-903c-52025db684f1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2062842515", "networks": [{"uuid": "8f2d3188-a9be-41ca-b256-7809cb1ea9ae"}]}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:03:59.602383 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:59.603103 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:03:59.653316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.network.neutron [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] validate_networks() for [('8f2d3188-a9be-41ca-b256-7809cb1ea9ae', None, None, None, None, None)] {{(pid=120731) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 17:04:00.127928 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Flavor limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 17:04:00.128490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Image limits 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 17:04:00.128965 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Flavor pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 17:04:00.129632 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Image pref 0:0:0 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 17:04:00.129894 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.virt.hardware [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 17:04:00.138885 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:00.139365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:00.139803 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:00.140579 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:00.141028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:00.141483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:00.158543 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Getting quotas for project 7cfc50ac33174447af8f4a7ecc6cc125. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 17:04:00.162797 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Getting quotas for user 4f62872ebbfd471b9db50bcc401a1768 and project 7cfc50ac33174447af8f4a7ecc6cc125. Resources: {'cores', 'instances', 'ram'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 17:04:00.175133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Going to run 1 instances... {{(pid=120731) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 17:04:00.177365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='617be961-f4fa-42c9-903c-52025db684f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 17:04:00.235737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b8ec8e9-8ff8-47a7-963f-bf055bf49195 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646639 Aug 11 17:04:00.237334 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1396/2519] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 17:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 17:04:00.248000 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4a48f5d7-9adc-4812-a74e-a4e8e31383ce tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:00.248734 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4a48f5d7-9adc-4812-a74e-a4e8e31383ce tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:00.321796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4a48f5d7-9adc-4812-a74e-a4e8e31383ce tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:00.328923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4a48f5d7-9adc-4812-a74e-a4e8e31383ce tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1259 microversion: 2.1 time: 0.084725 Aug 11 17:04:00.330210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1124/2520] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:00 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1259 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:01.350796 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:01.351648 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:01.359015 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:01.359508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:01.359952 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:01.360765 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:01.361279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:01.361806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:01.428716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:01.438685 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-e685552c-7bef-4071-ac5e-0d4e5bbe6336 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1319 microversion: 2.1 time: 0.093278 Aug 11 17:04:01.441359 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1397/2521] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:01 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:04:02.461352 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:02.462924 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:02.491716 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:02.494235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:02.494893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:02.496962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:02.503466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:02.510468 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:02.927409 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:02.940995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-41b86342-e2b4-4f8a-a8ba-ac53c7d0d70e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.483473 Aug 11 17:04:02.941951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1125/2522] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:02 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:03.663829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:03.682062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:03.687961 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:03.688560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:03.739336 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] Creating event network-changed:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:04:03.746207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-9aaca31e-441f-4d8f-b64d-b3391b176e5e req-8e886f7e-3623-40df-9063-385a261354b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086010 Aug 11 17:04:03.751041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1398/2523] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:03.967512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:03.968146 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:03.986729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:03.987841 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:03.988459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:03.994061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:03.994723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:03.995254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:04.400908 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:04.419989 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c9dcb634-d3c6-4b3f-a4e7-dec7bf7f36ae tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.455361 Aug 11 17:04:04.426672 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1126/2524] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:03 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:05.450852 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:05.451554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:05.474788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:05.482808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:05.483246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:05.484025 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:05.489809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:05.491117 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:05.872049 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:05.893778 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d4b56208-f85d-4473-bcb6-c930e55ec815 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.441634 Aug 11 17:04:05.910665 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1399/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:05 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:06.919601 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:06.920279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:06.936314 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:06.937723 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:06.940309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:06.941248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:06.943220 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:06.945126 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:07.194061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:07.212952 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bfa11b9d-c865-4664-a866-6cc3d1608a9d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.297144 Aug 11 17:04:07.214023 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1127/2526] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:06 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:08.233974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:08.234638 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:08.241792 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:08.242826 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:08.243497 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:08.244694 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:08.245356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:08.245985 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:08.396339 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:08.405303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5b94971b-31dc-47b3-bfcf-9c4440a49664 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.174385 Aug 11 17:04:08.406408 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1400/2527] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:08 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:09.426779 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:09.427428 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:09.433981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:09.434466 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:09.434934 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:09.435633 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:09.436084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:09.436546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:09.614293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:09.623301 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-888417ee-9d37-4ee6-8b31-62bfe0a06bea tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.200177 Aug 11 17:04:09.624236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1128/2528] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:09 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:10.648218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:10.649705 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:10.652379 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:10.653654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=6 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:10.661154 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:10.662059 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:10.662503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:10.663295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:10.663805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:10.664447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:10.847595 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:10.856295 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-2eba0158-ec6a-423c-9fc6-1574a873e598 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.213578 Aug 11 17:04:10.857186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1401/2529] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:10 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:11.878567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:11.879188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:11.882114 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:11.886733 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:11.887213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:11.887642 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:11.888351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:11.888798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:11.889215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:12.027678 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:12.035533 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-1974cc88-b33d-4073-a7f7-01308704a23b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.161534 Aug 11 17:04:12.036135 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1129/2530] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:11 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:13.057106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:13.059044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:13.065633 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:13.066080 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:13.066516 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:13.067224 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:13.067682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:13.068128 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:13.211186 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:13.219565 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-19dd8c8c-807a-4fca-b096-9cdaa49da3c3 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.166361 Aug 11 17:04:13.220609 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1402/2531] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:13 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:14.241660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:14.243078 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:14.253648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:14.255046 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:14.256215 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:14.257459 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:14.257931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:14.258729 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:14.425169 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:14.435338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cea94b3d-1636-47d4-a335-572cd3e160de tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.198325 Aug 11 17:04:14.436476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1130/2532] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:14 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:15.457492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:15.458179 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:15.465081 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:15.465629 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:15.466162 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:15.466917 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:15.467437 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:15.468077 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:15.617199 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:15.625110 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-795001ab-a489-4198-b464-daeac92d2c6b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.171653 Aug 11 17:04:15.625675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1403/2533] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:15 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:16.646353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:16.647706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:16.655895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:16.656644 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:16.657265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:16.658809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:16.659457 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:16.659887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:16.779964 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "name": "network-vif-plugged", "status": "completed", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:16.807197 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:16.808994 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:16.809640 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:16.826433 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] Creating event network-vif-plugged:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:04:16.835530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-8c7adec8-00de-4f0b-9ed7-63c50b39be33 req-fba46d88-2e76-4be5-9819-32b7b1fa1ef5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323337 Aug 11 17:04:16.839019 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1131/2534] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:16.851330 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:16.859656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ec9b31e1-5195-4968-8376-3997dcfa1761 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.217541 Aug 11 17:04:16.861467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1404/2535] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:16 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:04:17.883665 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:17.885917 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:17.892938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:17.893820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:17.893820 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:17.894546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:17.894986 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:17.895594 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:18.325799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:18.339610 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-aa4bf4ed-d5c2-4823-9f2c-2d03f9f17163 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1359 microversion: 2.1 time: 0.460539 Aug 11 17:04:18.340548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1132/2536] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:17 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:19.361533 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:19.362293 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:19.368919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.369365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.369794 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.370480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.371006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.371352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.512453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:19.520442 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-d956cdb3-c6fb-4000-afa6-0b859c152f9a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1550 microversion: 2.1 time: 0.162823 Aug 11 17:04:19.521006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1405/2537] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:19 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:19.540292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:19.540902 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:19.547247 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.547728 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.548951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.549834 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.550374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.550801 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.685194 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:19.693996 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bb998f48-5a11-47ec-b9c3-76f30b007263 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1550 microversion: 2.1 time: 0.157506 Aug 11 17:04:19.694576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1133/2538] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:19 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:19.717971 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:19.723350 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:19.724148 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Searching by: {'deleted': False, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125'} {{(pid=120731) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 11 17:04:19.731887 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.732431 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.732838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.733599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.734111 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.734503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.829611 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.multi_cell_list [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120731) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 11 17:04:19.930740 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c7140cc4-8845-4ded-a671-37a799e49830 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216492 Aug 11 17:04:19.938327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1406/2539] 10.222.0.43 () {58 vars in 1125 bytes} [Thu Aug 11 17:04:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:19.944547 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:19.945150 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:19.951304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.951776 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.952228 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:19.952906 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:19.953350 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:19.953765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:20.080670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:20.088030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-71b7b532-2ead-4d02-b47d-813f013c4e70 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1550 microversion: 2.1 time: 0.147270 Aug 11 17:04:20.088623 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1134/2540] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:19 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:22.688020 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d36f1078-23c2-44c1-acff-1ee1d4520b08"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:22.690675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:22.697226 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:22.697709 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:22.698146 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:22.698857 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:22.699305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:22.699725 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:25.271274 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-7cc42e69-2b57-4531-aa7f-4c1142dc2e36 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.587069 Aug 11 17:04:25.271891 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1407/2541] 10.222.0.43 () {60 vars in 1323 bytes} [Thu Aug 11 17:04:22 2022] POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments => generated 194 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:37.419937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:37.420912 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:37.426360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:37.427298 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=56 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:37.432502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:37.433310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:37.433933 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:37.434816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:37.435434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:37.436043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:37.637374 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:37.645963 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-497f8979-facc-4125-961e-6fb759d45a0c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1596 microversion: 2.1 time: 0.234781 Aug 11 17:04:37.661014 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1135/2542] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:37 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1596 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:37.785682 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:37.787440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:37.788914 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:38.082204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-91d06210-5e0c-46f8-93e1-a64b130a3ad4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Action: 'create', calling method: .version_select at 0x7f6143480d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-988833824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP81/0rC+GBMbPA/0DtxgsFTTe4XXQaf4+MFKddC2nIM2Gprv7aR+3Mt9VM5vRaLAfa45tqm15iWGlZFuRvzbiP/FHP9Eyf3/kxdQYVPU83FTzF7Snhuhnh0rVDc93sk7Q=="}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:38.104512 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-91d06210-5e0c-46f8-93e1-a64b130a3ad4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Getting quotas for project e75db9cf63624704afe00066b973360b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 17:04:38.112591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.quota [None req-91d06210-5e0c-46f8-93e1-a64b130a3ad4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Getting quotas for user 99baf25bdb4340b8a7947f08e426bd46 and project e75db9cf63624704afe00066b973360b. Resources: {'key_pairs'} {{(pid=120731) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 17:04:38.152317 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-91d06210-5e0c-46f8-93e1-a64b130a3ad4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.371941 Aug 11 17:04:38.156619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1408/2543] 10.222.0.43 () {60 vars in 1159 bytes} [Thu Aug 11 17:04:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:40.042948 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:40.070049 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:40.070543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:40.071061 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:40.104514 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] Creating event network-changed:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:04:40.118035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-ec567680-7b86-4842-9b0b-00bdf236801b req-a75b94ef-8b6e-4bda-9d91-dcba02abfec4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170240 Aug 11 17:04:40.123356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1136/2544] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:41.978628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-865491794"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:41.979505 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:41.991197 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:41.991766 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:41.992320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:41.993504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:41.995198 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:41.995706 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:42.161737 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.network.security_group_api [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Adding security group b77b5a70-488d-40d8-b553-7f59c3aebf28 to port 10af1d58-cb5a-474a-b3af-3765c24c7e00 Aug 11 17:04:42.626537 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-139917d0-c818-40e5-80f6-4d48ea7fb9b1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action" status: 202 len: 0 microversion: 2.1 time: 0.652192 Aug 11 17:04:42.627378 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1409/2545] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 17:04:41 2022] POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:04:42.647097 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:42.647893 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:42.650972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:42.662161 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:42.662908 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:42.663758 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:42.665375 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:42.666246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:42.666845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:42.667330 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:42.667567 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:42.667765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:42.690084 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] Creating event network-changed:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:04:42.695138 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-c1a5d95a-23d2-4d71-9422-8fd0d1b294af req-c5ef3f2f-a67d-47ec-85c5-030d420ab9df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063423 Aug 11 17:04:42.695739 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1137/2546] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:04:42.826004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:42.834770 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-44ead4e5-9679-4649-bd0e-106dc791d249 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1761 microversion: 2.1 time: 0.198348 Aug 11 17:04:42.835333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1410/2547] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:42 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1761 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:56.304946 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:56.305870 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=10 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:56.310030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-598817963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-988833824", "security_groups": [{"name": "tempest-secgroup-smoke-999061808"}], "networks": [{"uuid": "281bd016-c7b2-4c69-9d48-34706e1fad95"}], "block_device_mapping_v2": [{"uuid": "ff4393ef-d458-48e1-afb0-974cd2af2120", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:56.436798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.network.neutron [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] validate_networks() for [('281bd016-c7b2-4c69-9d48-34706e1fad95', None, None, None, None, None)] {{(pid=120730) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 17:04:56.931826 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Flavor limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 17:04:56.932292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Image limits 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 17:04:56.932799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Flavor pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 17:04:56.933212 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Image pref 0:0:0 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 17:04:56.933627 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.virt.hardware [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120730) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 17:04:56.942471 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:56.942954 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:56.943635 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:56.944398 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:56.944853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:56.945272 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:56.962700 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Getting quotas for project e75db9cf63624704afe00066b973360b. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 17:04:56.967128 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.quota [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Getting quotas for user 99baf25bdb4340b8a7947f08e426bd46 and project e75db9cf63624704afe00066b973360b. Resources: {'cores', 'instances', 'ram'} {{(pid=120730) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 17:04:57.025066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Going to run 1 instances... {{(pid=120730) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 17:04:57.027332 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff4393ef-d458-48e1-afb0-974cd2af2120',volume_size=None,volume_type=None)] {{(pid=120730) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 17:04:57.164076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8989940c-6798-42d2-bf73-7e4ae0cba054 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860510 Aug 11 17:04:57.165177 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1138/2548] 10.222.0.43 () {60 vars in 1147 bytes} [Thu Aug 11 17:04:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 17:04:57.177031 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-33e338de-bb74-4c61-b18c-b984ee9bf93a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:57.177643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-33e338de-bb74-4c61-b18c-b984ee9bf93a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:57.180131 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=4 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:57.180805 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:57.181443 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=10 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:04:57.240589 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-33e338de-bb74-4c61-b18c-b984ee9bf93a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:57.247970 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-33e338de-bb74-4c61-b18c-b984ee9bf93a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1087 microversion: 2.1 time: 0.075553 Aug 11 17:04:57.248686 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1411/2549] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:57 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:04:58.274785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:58.276647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:58.289461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:58.290502 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:58.291304 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:58.292377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:58.292995 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:58.293579 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:58.418689 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:58.427392 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d8c04b51-9b47-4836-8749-96ef36e0410c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1203 microversion: 2.1 time: 0.161808 Aug 11 17:04:58.428496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1139/2550] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:58 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:59.449164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:04:59.449777 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:04:59.458722 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:59.459211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:59.459654 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:59.460380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:59.460833 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:59.461253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:59.598007 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:04:59.610116 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b8ec7fcc-8cea-4907-816a-89cb86209b0c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.164779 Aug 11 17:04:59.611143 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1412/2551] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:04:59 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:04:59.628597 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:04:59.640091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:04:59.640758 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:04:59.641276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:04:59.657071 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] Creating event network-changed:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:04:59.662878 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-161bf684-aefe-4b7a-99d0-306ca090981f req-44404c56-06b9-4ed5-b429-288195fd901a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038392 Aug 11 17:04:59.663614 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1140/2552] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:05:00.633152 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:00.633768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:00.642532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:00.649207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:00.650467 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:00.653898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:00.654627 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:00.655528 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:00.842468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:00.854319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-92562ac0-b9cb-4021-bf92-75b9d6387ef3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.225632 Aug 11 17:05:00.854916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1413/2553] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:00 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:01.881426 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:01.882108 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:01.888277 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:01.888749 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:01.889180 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:01.889853 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:01.890296 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:01.890713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:02.023355 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:02.031553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-20b2d508-327a-4c90-8979-a875f2f713c6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.155246 Aug 11 17:05:02.032213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1141/2554] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:01 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:03.053195 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:03.053915 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:03.060322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.060808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.061246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.061962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.062415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.062838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.202268 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:03.211418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1287bd3b-53f8-484c-b56c-64ea430975b7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.162735 Aug 11 17:05:03.212338 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1414/2555] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:03 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:03.363647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:05:03.365830 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:03.372210 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.372687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.373120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.373799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.374248 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.374668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.447118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-93619c32-be6c-4102-a449-ce3a4e2ffa54 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action" status: 202 len: 0 microversion: 2.1 time: 0.087745 Aug 11 17:05:03.450647 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1142/2556] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 17:05:03 2022] POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:05:03.457279 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:03.457989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:03.464012 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.464600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.465119 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.465809 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:03.466256 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:03.466711 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:03.609373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:03.618306 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-5ff50b4a-3268-4803-9bca-a56105abc28a tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1753 microversion: 2.1 time: 0.165765 Aug 11 17:05:03.618798 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1415/2557] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:03 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:04.233576 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:04.234293 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:04.240774 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:04.241245 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:04.241673 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:04.242348 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:04.242790 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:04.243208 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:04.373785 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:04.381552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-62e3024e-fac5-4fcb-8890-49250348b4ca tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.152185 Aug 11 17:05:04.382120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1143/2558] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:04 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:04.640954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:04.641493 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:04.648566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:04.649041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:04.649466 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:04.650140 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:04.650584 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:04.651001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:04.791872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:04.799877 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-1d33d5f4-8bf2-45b4-a2e6-5f226ef839c1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1753 microversion: 2.1 time: 0.162828 Aug 11 17:05:04.800507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1416/2559] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:04 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:05.401478 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:05.402121 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:05.408595 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:05.409083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:05.409520 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:05.410940 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:05.411395 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:05.411823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:05.546708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:05.554919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-51c35518-8d6b-4e31-aed7-efc7af2e1853 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.157329 Aug 11 17:05:05.555487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1144/2560] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:05 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:05.825440 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:05.826217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:05.833721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:05.834247 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:05.834745 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:05.835397 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:05.835866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:05.836319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:06.216421 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:06.224469 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f66f2f3d-062d-4504-b34a-937c2d673fe9 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1753 microversion: 2.1 time: 0.402899 Aug 11 17:05:06.225047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1417/2561] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:05 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1753 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:06.576603 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:06.577504 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:06.585253 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:06.585886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:06.586337 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:06.587218 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:06.587797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:06.588480 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:06.731876 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:06.739919 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0e6d23ea-1742-42d8-9e35-a82a49563d08 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.167577 Aug 11 17:05:06.740450 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1145/2562] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:06 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:07.245419 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:07.246036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:07.248415 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell0:SELECT=2 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:07.254291 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:07.254962 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:07.255400 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:07.256088 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:07.256580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:07.256990 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:07.399412 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:07.407301 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-41bb1dda-1e26-4f4a-8af1-a34208c2ff5d tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1753 microversion: 2.1 time: 0.165688 Aug 11 17:05:07.407856 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1418/2563] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:07 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:07.760178 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:07.760792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:07.762759 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=2 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:07.763485 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell0:SELECT=6 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:07.770798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:07.771279 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:07.771721 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:07.772437 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:07.772888 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:07.773310 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:07.903462 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:07.912033 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a23686cb-0bac-4bf3-93a5-1667f051973d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.155734 Aug 11 17:05:07.912629 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1146/2564] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:07 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:08.428956 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:08.429566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:08.435933 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:08.436450 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:08.436889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:08.437576 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:08.438027 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:08.438449 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:08.578902 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:08.587435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-701f1a75-5c5c-48ac-b091-30a37a472b58 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1753 microversion: 2.1 time: 0.162388 Aug 11 17:05:08.587989 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1419/2565] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:08 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:08.933380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:08.934064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:08.941151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:08.941875 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:08.942309 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:08.943004 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:08.943446 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:08.944043 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:09.157538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:09.166615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-383cf49e-3596-4f95-929e-63893cd18425 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.237062 Aug 11 17:05:09.167251 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1147/2566] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:08 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:09.609058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:09.609670 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:09.616342 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:09.616823 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:09.617259 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:09.617938 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:09.618389 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:09.618816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:09.758546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:09.766498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-85217da3-0df5-4061-85de-9659e2f6e81e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.161361 Aug 11 17:05:09.767056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1420/2567] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:09 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:10.187407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:10.188066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:10.195693 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:10.196461 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:10.196897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:10.197588 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:10.198119 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:10.198706 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:10.353890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:10.361454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-af1aeb80-5c36-4f3a-8ef4-502ba3e009a4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.177927 Aug 11 17:05:10.362027 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1148/2568] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:10 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:10.788972 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:10.789591 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:10.795966 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:10.796479 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:10.796916 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:10.797600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:10.798045 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:10.798464 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:10.944253 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:10.952433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-66100a64-3ca0-48cd-8e71-af26f4e61309 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.167662 Aug 11 17:05:10.952999 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1421/2569] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:10 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:11.383159 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:11.383765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:11.389692 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:11.390162 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:11.390591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:11.391262 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:11.391708 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:11.392224 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:11.526376 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:11.533845 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-a5c161e3-a6c6-4e31-92f3-d01e5905910d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.155602 Aug 11 17:05:11.534407 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1149/2570] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:11 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:11.974816 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:11.975391 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:11.981872 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:11.982348 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:11.982776 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:11.983453 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:11.983897 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:11.984341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:12.123895 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:12.132381 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-22713c01-c7af-4bf0-a775-6dfff9fccac2 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.162050 Aug 11 17:05:12.132935 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1422/2571] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:11 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:12.341962 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "name": "network-vif-plugged", "status": "completed", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:05:12.351810 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:12.352323 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:12.353214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:12.364735 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] Creating event network-vif-plugged:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:05:12.369807 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-a62ec7a3-3a6c-42fb-b0a6-21df51c5442b req-014d65a3-37d0-4f8f-8546-f6800f752dbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Aug 11 17:05:12.370555 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1150/2572] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:05:12.555294 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:12.555907 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:12.561947 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:12.562423 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:12.562854 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:12.563532 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:12.563981 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:12.564429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:12.698656 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:12.706284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a62ccf12-c3c8-450a-865d-d2fe569b99bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.154878 Aug 11 17:05:12.707014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1423/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:12 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:13.155164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:13.155850 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:13.162883 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:13.163356 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:13.163792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:13.164517 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:13.164982 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:13.165403 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:13.371089 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:13.379856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-403e1d55-08cb-4c83-8f0a-8c904990ac5e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.229335 Aug 11 17:05:13.380543 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1151/2574] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:13 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:13.727262 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:13.727802 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:13.733889 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:13.734373 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:13.734812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:13.735503 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:13.735958 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:13.736417 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:13.868774 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:13.876427 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-17984c37-db6a-4b37-810f-a1d087beb608 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.154116 Aug 11 17:05:13.876986 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1424/2575] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:13 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:14.401454 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:14.402109 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:14.408755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:14.409280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:14.409957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:14.410745 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:14.411244 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:14.411670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:14.553338 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:14.561320 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-8f715823-1a94-4462-84ef-7a374f208328 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.163666 Aug 11 17:05:14.561877 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1152/2576] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:14 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:05:14.901086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:14.901702 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:14.908157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:14.908645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:14.909086 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:14.910549 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:14.911008 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:14.911438 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:15.042171 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:15.049810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-96a830b9-b01e-4df4-ab03-f233a1d30e5b tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.152543 Aug 11 17:05:15.051006 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1425/2577] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:14 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:15.583467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:15.584129 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:15.591246 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:15.591732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:15.592199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:15.592897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:15.593373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:15.593799 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:15.735498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:15.743477 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0741030-b66b-4547-ba53-c71b34e99537 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.164406 Aug 11 17:05:15.744048 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1153/2578] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:15 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:16.072033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:16.072683 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:16.079322 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:16.079801 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:16.080264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:16.080944 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:16.081513 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:16.082352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:16.212178 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:16.219604 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f772a1b9-7510-4f0d-bf10-8679851c6da5 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1258 microversion: 2.1 time: 0.151493 Aug 11 17:05:16.220184 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1426/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:16 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:16.764925 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:16.765544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:16.772668 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:16.773227 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:16.773846 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:16.774624 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:16.775473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:16.775598 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:16.928570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:16.936615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-4ef346ae-9fd3-4a77-8d48-8172be4e8eca tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.175450 Aug 11 17:05:16.937170 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1154/2580] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:16 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:17.240233 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:17.240841 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:17.248323 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.249310 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.249929 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.251016 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.251601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.252024 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.390243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:17.397810 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-ab557d16-a794-4fbd-a392-65708d214369 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1443 microversion: 2.1 time: 0.162121 Aug 11 17:05:17.398368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1427/2581] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:17 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:17.417475 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:17.418083 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:17.423955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.424457 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.424887 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.426306 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.426754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.427172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.445967 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:17.567282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:17.575242 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5c2df7c1-ca8a-4b9c-a5ef-e81e0410964e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1443 microversion: 2.1 time: 0.161666 Aug 11 17:05:17.575812 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1155/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:17 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:17.959492 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:17.961133 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:17.969551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.970483 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.971614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.973276 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:17.974000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:17.974601 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:17.995487 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=100 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:18.225599 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:18.233749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-f34cddfe-bc25-4bb1-a536-fa57a2ff714c tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.279366 Aug 11 17:05:18.234313 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1428/2583] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:17 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:19.255654 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:19.256285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:19.262806 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:19.263401 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:19.263898 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:19.264687 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:19.265133 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:19.265554 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:19.424525 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:19.433717 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-135de7fc-2280-4a24-9f37-aeae8463b872 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.182765 Aug 11 17:05:19.434612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1156/2584] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:19 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:19.521285 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:05:19.531325 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:19.531898 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:19.532377 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:19.543983 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] Creating event network-changed:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:05:19.549093 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-938654bf-4dfe-484d-906d-969ca8b566cb req-69ab5271-cba4-42a7-b741-d31c969fc6bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032308 Aug 11 17:05:19.549672 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1429/2585] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:05:20.455534 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:20.456168 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:20.463007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:20.463496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:20.463931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:20.464650 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:20.465111 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:20.465538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:20.651553 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:20.659630 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-cd5a081b-0b06-4b17-bc72-27a5f7a01fe8 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.208236 Aug 11 17:05:20.660196 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1157/2586] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:20 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:21.682108 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:21.682806 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:21.689125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:21.689680 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:21.690252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:21.691992 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:21.692671 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:21.693365 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:21.857560 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:21.867166 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-def4f04e-4568-4190-9498-3911d67198c7 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1758 microversion: 2.1 time: 0.189673 Aug 11 17:05:21.867997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1430/2587] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:21 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:05:22.890617 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:05:22.891229 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:22.899353 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:22.899842 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:22.900311 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:22.901025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:22.901476 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:22.901895 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:23.049235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:05:23.058544 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-3fdb4f1d-b093-43f8-96a3-664661804b15 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1761 microversion: 2.1 time: 0.171634 Aug 11 17:05:23.058966 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1158/2588] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:05:22 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:05:58.863060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-865491794"}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:05:58.863606 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:05:58.866546 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=42 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:58.867218 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=10 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:58.875501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:58.876406 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:58.877292 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:58.878448 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:58.879074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:58.879689 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:59.009788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.network.security_group_api [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Removing security group b77b5a70-488d-40d8-b553-7f59c3aebf28 from port 10af1d58-cb5a-474a-b3af-3765c24c7e00 Aug 11 17:05:59.308838 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6eb544c2-0601-420d-b75b-917bc7ca8f21 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action" status: 202 len: 0 microversion: 2.1 time: 0.449633 Aug 11 17:05:59.317106 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1431/2589] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 17:05:58 2022] POST /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:05:59.319886 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:05:59.325152 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:59.325992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=20 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:05:59.331294 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:05:59.331755 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:05:59.332217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:05:59.345148 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.compute.server_external_events [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] Creating event network-changed:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:05:59.350702 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [req-358f29e1-c624-478d-9788-692a5706ce76 req-37997c30-8d2b-446e-b653-0be441a35e0c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Aug 11 17:05:59.351575 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1159/2590] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:06:00.705510 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:00.706033 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:00.712721 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:00.713211 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:00.713645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:00.714341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:00.714791 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:00.715213 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:00.797340 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lazy-loading 'services' on Instance uuid 5e525e53-5105-4d21-b20f-d2c801f708ef {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:06:00.874004 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-bddc6696-16ca-498b-8567-514ea3a4dd02 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments/d36f1078-23c2-44c1-acff-1ee1d4520b08" status: 202 len: 0 microversion: 2.1 time: 0.173859 Aug 11 17:06:00.887368 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1432/2591] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 17:06:00 2022] DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments/d36f1078-23c2-44c1-acff-1ee1d4520b08 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:06:00.893007 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:00.895283 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:00.901713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:00.902435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:00.903028 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:00.903893 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:00.904377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:00.904984 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:00.940524 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9a49d39a-fa0b-4acf-996f-7b0f97706d3e tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052233 Aug 11 17:06:00.941269 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1160/2592] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 17:06:00 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 17:06:01.373341 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:06:01.384401 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:01.384888 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:01.385320 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:01.399352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] Creating event network-changed:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:06:01.404439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-f75e3836-7b45-432e-9329-15efd9ebc785 req-0c23fb9c-6c87-4b84-ac22-478ab7707952 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035168 Aug 11 17:06:01.405918 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1433/2593] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:06:01.954098 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:01.956285 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:01.963289 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:01.963792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:01.964260 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:01.964937 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:01.965380 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:01.965797 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:01.992992 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5c27ec11-2cc1-4012-8cc4-ec45666664be tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043131 Aug 11 17:06:01.993549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1161/2594] 10.222.0.43 () {58 vars in 1302 bytes} [Thu Aug 11 17:06:01 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 17:06:02.004866 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:02.005470 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:02.012768 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:02.013252 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:02.013675 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:02.014645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:02.015099 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:02.015521 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:02.090267 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] HTTP exception thrown: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef is not attached to volume d36f1078-23c2-44c1-acff-1ee1d4520b08 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Request method failure captured: Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments/d36f1078-23c2-44c1-acff-1ee1d4520b08 HTTP/1.1 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9TZt9Zkpg5oZs7E6lRLtOY-R-8gz_ujmzumOwMSNetLovSpfItCTpajcmhDjPzEhRo2fPDZkL1t2OFUESNOjRAZuXo1rdpQZ4kgA6pCFAwTdA9YqCXovrNcFXcR2IqExkhQZ09nyMvM9PreSqQtNWeLzSvBG9njEXp7mAxZiy2VaqNc Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 7cfc50ac33174447af8f4a7ecc6cc125 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 17:06:02.092662 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cfc50ac33174447af8f4a7ecc6cc125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cfc50ac33174447af8f4a7ecc6cc125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cfc50ac33174447af8f4a7ecc6cc125", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cfc50ac33174447af8f4a7ecc6cc125"}]}] Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 7cfc50ac33174447af8f4a7ecc6cc125 Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-TestMinimumBasicScenario-381225879-project Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 4f62872ebbfd471b9db50bcc401a1768 Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestMinimumBasicScenario-381225879-project Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 17:06:02.094001 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef is not attached to volume d36f1078-23c2-44c1-acff-1ee1d4520b08 Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'server_id': '5e525e53-5105-4d21-b20f-d2c801f708ef', 'id': 'd36f1078-23c2-44c1-acff-1ee1d4520b08'} Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d36f1078-23c2-44c1-acff-1ee1d4520b08. Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:06:02.098037 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef is not attached to volume d36f1078-23c2-44c1-acff-1ee1d4520b08 Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef is not attached to volume d36f1078-23c2-44c1-acff-1ee1d4520b08 Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:02.099250 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Returning 404 to user: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef is not attached to volume d36f1078-23c2-44c1-acff-1ee1d4520b08 {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:06:02.100355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6da8faf0-5980-4136-a50d-9449aa3e3424 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments/d36f1078-23c2-44c1-acff-1ee1d4520b08" status: 404 len: 154 microversion: 2.1 time: 0.093899 Aug 11 17:06:02.100355 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1434/2595] 10.222.0.43 () {58 vars in 1416 bytes} [Thu Aug 11 17:06:01 2022] DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef/os-volume_attachments/d36f1078-23c2-44c1-acff-1ee1d4520b08 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:06:03.232832 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:03.233334 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:03.239750 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:03.240274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:03.240714 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:03.241667 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:03.242131 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:03.242560 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:03.268286 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 17:06:03.342235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-d61a9706-0e47-4197-b2b2-a7b9185e97e1 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 204 len: 0 microversion: 2.1 time: 0.112720 Aug 11 17:06:03.342981 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1162/2596] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 17:06:03 2022] DELETE /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 17:06:03.352036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:03.352716 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:03.359125 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:03.359608 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:03.360042 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:03.360763 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:03.361217 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:03.361643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:03.494551 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:06:03.502058 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b4250386-75db-41fc-bc0c-694f81a9045b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1556 microversion: 2.1 time: 0.154613 Aug 11 17:06:03.502615 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1435/2597] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:06:03 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:06:04.525496 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:04.526124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:04.532587 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:04.533076 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:04.533513 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:04.534202 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:04.534655 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:04.535074 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:04.665042 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:06:04.672573 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-5d3d0fd4-ffb5-40d9-b861-db12b9dc4f1b tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1556 microversion: 2.1 time: 0.152136 Aug 11 17:06:04.673140 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1163/2598] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:06:04 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:06:05.440220 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e525e53-5105-4d21-b20f-d2c801f708ef", "name": "network-vif-deleted", "tag": "10af1d58-cb5a-474a-b3af-3765c24c7e00"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:06:05.450876 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:05.451352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:05.451781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:05.463554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] Creating event network-vif-deleted:10af1d58-cb5a-474a-b3af-3765c24c7e00 for instance 5e525e53-5105-4d21-b20f-d2c801f708ef on hv-cinder-85220 Aug 11 17:06:05.468630 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-42262784-8d02-4c7a-8fa5-f907d5d32b54 req-23a3540d-fecb-4cea-bb93-29e2b4ae97c5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Aug 11 17:06:05.469215 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1436/2599] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:06:05.694615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:05.695188 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:05.701928 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:05.702412 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:05.703101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:05.703802 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:05.704280 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:05.704704 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:05.738203 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:05.738683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:05.739118 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:05.739570 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lazy-loading 'fault' on Instance uuid 5e525e53-5105-4d21-b20f-d2c801f708ef {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:06:05.786970 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f62872ebbfd471b9db50bcc401a1768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cfc50ac33174447af8f4a7ecc6cc125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:06:05.797039 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-037d6f72-4de3-49a6-b52b-968b0244db93 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 200 len: 1349 microversion: 2.1 time: 0.106515 Aug 11 17:06:05.798035 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1164/2600] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:06:05 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:06:06.820063 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:06.820822 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [instance: 5e525e53-5105-4d21-b20f-d2c801f708ef] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:06:06.827062 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:06.827545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:06.828281 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:06.828977 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:06:06.829433 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:06:06.829861 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:06:06.843429 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] HTTP exception thrown: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Request method failure captured: Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef HTTP/1.1 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9TZt9Zkpg5oZs7E6lRLtOY-R-8gz_ujmzumOwMSNetLovSpfItCTpajcmhDjPzEhRo2fPDZkL1t2OFUESNOjRAZuXo1rdpQZ4kgA6pCFAwTdA9YqCXovrNcFXcR2IqExkhQZ09nyMvM9PreSqQtNWeLzSvBG9njEXp7mAxZiy2VaqNc Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: 7cfc50ac33174447af8f4a7ecc6cc125 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 17:06:06.845064 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cfc50ac33174447af8f4a7ecc6cc125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cfc50ac33174447af8f4a7ecc6cc125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cfc50ac33174447af8f4a7ecc6cc125", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cfc50ac33174447af8f4a7ecc6cc125"}]}] Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: 7cfc50ac33174447af8f4a7ecc6cc125 Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381225879 Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-TestMinimumBasicScenario-381225879-project Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 4f62872ebbfd471b9db50bcc401a1768 Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestMinimumBasicScenario-381225879-project Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. Aug 11 17:06:06.846305 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '5e525e53-5105-4d21-b20f-d2c801f708ef'} Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:06:06.847036 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. Aug 11 17:06:06.848485 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:06:06.849723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Returning 404 to user: Instance 5e525e53-5105-4d21-b20f-d2c801f708ef could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:06:06.849723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-aee1f872-ee2f-4cbe-92a2-d99a746f2315 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef" status: 404 len: 111 microversion: 2.1 time: 0.031049 Aug 11 17:06:06.849723 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1437/2601] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:06:06 2022] GET /compute/v2.1/servers/5e525e53-5105-4d21-b20f-d2c801f708ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:06:06.855486 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bce8ee29-17e9-4d23-a290-0ccaf6e51871 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] Calling method '.version_select at 0x7f614bdb7dc0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:06:06.860034 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bce8ee29-17e9-4d23-a290-0ccaf6e51871 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [2411bbbf-0059-4dde-9214-ea9cbc17e150] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 17:06:07.868002 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [None req-bce8ee29-17e9-4d23-a290-0ccaf6e51871 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] [2411bbbf-0059-4dde-9214-ea9cbc17e150] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54910. Aug 11 17:06:07.888018 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bce8ee29-17e9-4d23-a290-0ccaf6e51871 tempest-TestMinimumBasicScenario-381225879 tempest-TestMinimumBasicScenario-381225879-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2062842515" status: 202 len: 0 microversion: 2.1 time: 1.036210 Aug 11 17:06:07.888660 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1165/2602] 10.222.0.43 () {58 vars in 1272 bytes} [Thu Aug 11 17:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2062842515 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:06:34.382180 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:06:34.382637 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:07:17.967991 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=14 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:07:17.968690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:07:17.972979 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:07:17.973498 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:17.980619 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:17.981096 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:17.981527 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:17.982200 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:17.982643 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:17.983057 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:18.005264 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.objects.instance [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lazy-loading 'flavor' on Instance uuid 403fcf42-32f4-45f9-9a19-8d77fe23c93a {{(pid=120731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:07:18.080303 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8a8a6d0b-8b8c-41d1-ab96-cd319a9e9db6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "POST /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a/action" status: 202 len: 0 microversion: 2.1 time: 0.113411 Aug 11 17:07:18.080863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1438/2603] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 17:07:17 2022] POST /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:07:18.088897 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:07:18.089631 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:07:18.094213 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:18.094816 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:18.104926 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:18.105435 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:18.105863 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:18.106552 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:18.106997 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:18.107413 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:18.446223 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:18.453747 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-bcd320e5-9533-4fa0-9c94-194e886aef7e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.368253 Aug 11 17:07:18.454567 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1166/2604] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:18 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:07:19.475201 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:19.476044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:19.482773 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:19.483251 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:19.483688 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:19.484404 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:19.484859 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:19.485284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:19.673124 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:19.681278 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-a0571c8e-7d69-40a9-99be-7472a7da70b4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.210364 Aug 11 17:07:19.681829 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1439/2605] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:19 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:20.703360 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:20.703998 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:20.712141 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:20.712838 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:20.713265 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:20.713951 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:20.714434 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:20.714859 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:20.846670 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:20.854467 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-c58314b5-ebdc-46de-a1b6-ca29fad42b38 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.155020 Aug 11 17:07:20.855029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1167/2606] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:20 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:21.874800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:21.875508 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:21.882663 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:21.883132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:21.883561 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:21.884272 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:21.884717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:21.885132 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:22.012946 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:22.020284 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-11ef75e7-d8c1-4a39-aeca-15e335e23f5c tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.149388 Aug 11 17:07:22.020834 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1440/2607] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:21 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:23.043346 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:23.043911 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:23.050274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:23.050781 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:23.051217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:23.051900 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:23.052373 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:23.052796 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:23.181835 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:23.189254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-80c1e9c8-57be-4919-80d3-bc0203eea571 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.149927 Aug 11 17:07:23.189813 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1168/2608] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:23 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:07:24.210456 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:24.210997 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:24.217468 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:24.217954 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:24.218387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:24.219071 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:24.219518 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:24.219937 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:24.355196 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:24.362646 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-6e337c5b-57ea-4349-884d-a3f826a97997 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.156260 Aug 11 17:07:24.363207 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1441/2609] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:24 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:25.384732 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:25.385308 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:25.391276 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:25.391754 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:25.392217 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:25.392931 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:25.393377 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:25.393798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:25.524593 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:25.532124 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ff05ada4-db7d-42a3-952b-be92b3de3b1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.152197 Aug 11 17:07:25.532696 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1169/2610] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:25 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:26.554242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:26.554975 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:26.561314 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:26.561800 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:26.562236 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:26.562925 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:26.563380 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:26.563808 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:26.696942 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:26.704684 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-cc4524a0-dd9a-44b9-a37b-b146f3ec7a1e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.154575 Aug 11 17:07:26.705242 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1442/2611] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:26 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:27.725862 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:27.726469 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:27.732905 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:27.733387 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:27.733823 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:27.734506 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:27.734957 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:27.735383 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:27.867530 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:27.875171 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-232eeb88-3ab1-41e7-a0c3-f60e0800a9bc tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.153090 Aug 11 17:07:27.875873 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1170/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:27 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:28.897409 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:28.897926 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:28.904517 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:28.905000 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:28.905447 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:28.906164 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:28.906620 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:28.907044 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:29.040441 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:29.048061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-af2dc691-7358-44ec-b3c2-538b85cb6206 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.154701 Aug 11 17:07:29.048641 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1443/2613] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:28 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:30.070295 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:30.070901 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:30.077386 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:30.077857 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:30.078282 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:30.078955 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:30.079400 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:30.080068 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:30.211319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:30.219662 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-ab56b0ba-ea4b-4400-a6bd-16baf1d7f5e6 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.153882 Aug 11 17:07:30.220538 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1171/2614] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:30 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:31.241296 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:31.241905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:31.248352 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.248836 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.249265 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.249945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.250394 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.250813 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.383026 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:31.390439 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-078ce95c-e639-4231-8581-aa559c119c05 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1508 microversion: 2.1 time: 0.153131 Aug 11 17:07:31.390998 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1444/2615] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:31 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:31.411204 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:07:31.411798 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:31.418199 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.418709 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.419151 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.419836 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.420319 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.420741 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.463120 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120730) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 17:07:31.528091 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-464f931a-bd50-4440-9fe0-2713bda2dfb0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "POST /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a/action" status: 202 len: 0 microversion: 2.1 time: 0.120680 Aug 11 17:07:31.528856 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1172/2616] 10.222.0.43 () {60 vars in 1278 bytes} [Thu Aug 11 17:07:31 2022] POST /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:07:31.536934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:31.537545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:31.543607 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.544090 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.544554 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.545240 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:31.545690 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:31.546114 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:31.716863 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:31.724764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-572f2bdd-e11f-4748-bd11-cbd576d11675 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1516 microversion: 2.1 time: 0.191704 Aug 11 17:07:31.726043 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1445/2617] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:31 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:32.747270 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:32.747881 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:32.755540 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:32.756036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:32.756546 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:32.757236 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:32.757683 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:32.758101 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:32.888052 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:32.895482 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-881ea058-ac3e-4a32-b8fa-3c6c6c4617d3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.152974 Aug 11 17:07:32.896036 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1173/2618] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:32 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:07:33.876204 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "name": "network-vif-unplugged", "status": "completed", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:07:33.886750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:33.887232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:33.887659 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:33.899545 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] Creating event network-vif-unplugged:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:07:33.904658 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-ed4c3431-cb61-492a-8bff-e81fc4ddce2a req-afbcc5fc-84fc-46dd-bafb-5a40adbeb97d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032207 Aug 11 17:07:33.905812 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1446/2619] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:07:33.918328 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:33.918890 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:33.926622 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:33.927112 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:33.927549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:33.928756 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:33.929214 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:33.929643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:34.064788 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:34.072612 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0b4f060b-1196-4823-be4f-52380871178a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.159629 Aug 11 17:07:34.073181 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1174/2620] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:33 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 17:07:35.095047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:35.095749 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:35.102695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:35.103176 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:35.103614 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:35.104333 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:35.104788 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:35.105212 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:35.240157 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:35.248501 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-c7da34c1-0999-4613-acf5-a96fffe91dfe tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.158085 Aug 11 17:07:35.249053 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1447/2621] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:35 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:36.269274 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:36.269918 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:36.276549 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:36.277030 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:36.277465 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:36.278149 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:36.278600 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:36.279029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:36.409090 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:36.417512 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-55ae8197-afca-4e75-b541-8f089f934f8d tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.152119 Aug 11 17:07:36.418130 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1175/2622] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:36 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:37.439405 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:37.439934 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:37.447014 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:37.447490 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:37.447919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:37.448697 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:37.449145 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:37.449566 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:37.582343 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:37.590041 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-3007b6b5-dd62-4aed-9621-24a0828e02c4 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.154584 Aug 11 17:07:37.590600 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1448/2623] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:37 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:38.610354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:38.611001 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:38.617648 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:38.618134 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:38.618572 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:38.619268 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:38.619722 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:38.620176 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:38.748451 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:38.756784 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-f0735df1-3999-4158-bf81-cf6a77283577 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.149642 Aug 11 17:07:38.757418 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1176/2624] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:38 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:39.779311 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:39.779919 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:39.786905 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:39.787385 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:39.788065 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:39.788786 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:39.789235 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:39.789653 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:39.972316 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:39.980781 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-b738c366-6daa-4da8-ac54-3762984b542e tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1574 microversion: 2.1 time: 0.205434 Aug 11 17:07:39.981356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1449/2625] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:39 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:41.001339 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:07:41.001953 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:07:41.009102 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:41.009584 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:41.010025 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:41.010713 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:41.011164 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:41.011591 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:41.149064 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:07:41.156705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-dab34935-5a3f-4c37-93b5-26825ad827f7 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1561 microversion: 2.1 time: 0.159282 Aug 11 17:07:41.157292 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1177/2626] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:07:40 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:07:41.976570 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "name": "network-vif-plugged", "status": "completed", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:07:41.987734 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:07:41.988243 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:07:41.988939 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:07:42.003232 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] Creating event network-vif-plugged:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:07:42.009101 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-6f8a9f12-ca35-46b9-94fd-9d7df99e9621 req-c6a52380-5923-4063-b9ce-1e80e1548083 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036835 Aug 11 17:07:42.009974 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1450/2627] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:08:32.679219 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 11 17:08:32.679765 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:08:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:08:54.892705 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:08:54.893661 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG dbcounter [-] [120730] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:08:54.896507 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_api:SELECT=26 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:08:54.897327 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG dbcounter [-] [120731] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 17:08:54.898351 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:54.898972 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:08:54.902890 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:08:54.907885 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:54.908473 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:54.908923 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:54.909720 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:54.910615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:54.910615 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:54.915569 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:54.916168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:54.916695 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:54.929319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] Creating event network-changed:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:08:54.934862 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-799f6888-a09e-40e6-86b2-11346de0e72c req-c4c32540-c63e-40b9-a8a2-71ffa11a5ec4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041265 Aug 11 17:08:54.935764 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1451/2628] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 17:08:54.939259 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Going to try to terminate instance {{(pid=120730) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 17:08:55.022935 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-0fe1ef78-d3a9-4157-be71-367f160f80bd tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "DELETE /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 204 len: 0 microversion: 2.1 time: 0.131940 Aug 11 17:08:55.024354 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1178/2629] 10.222.0.43 () {58 vars in 1239 bytes} [Thu Aug 11 17:08:54 2022] DELETE /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 17:08:55.034319 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:55.035628 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:08:55.048825 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:55.049418 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:55.049945 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:55.050717 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:55.055353 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:55.055994 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:55.216047 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.policy [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120731) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:08:55.223828 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-8491e561-3f0a-40bb-a0c5-5cec0ae95e6a tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.194387 Aug 11 17:08:55.224499 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1452/2630] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:08:55 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:08:56.245417 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:56.246643 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:08:56.253583 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:56.254067 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:56.254509 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:56.255201 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:56.255644 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:56.256057 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:56.408800 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:08:56.416235 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-489bec71-3d1b-4a68-bbe0-e1bfc25663a3 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1567 microversion: 2.1 time: 0.175028 Aug 11 17:08:56.416792 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1179/2631] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:08:56 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:08:57.083420 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403fcf42-32f4-45f9-9a19-8d77fe23c93a", "name": "network-vif-deleted", "tag": "f92c743b-049d-4ce7-b653-91561db92f7d"}]} {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 17:08:57.093515 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:57.094061 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:57.094504 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:57.106655 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.compute.server_external_events [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] Creating event network-vif-deleted:f92c743b-049d-4ce7-b653-91561db92f7d for instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a on hv-cinder-85220 Aug 11 17:08:57.111587 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [req-fe86b8b9-9dd7-46b6-b451-7fdeed311b94 req-8f91ce14-9ad8-40a7-9b37-1d70dfed1665 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096310 Aug 11 17:08:57.112246 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1453/2632] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Aug 11 17:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 17:08:57.440548 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:57.441155 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.compute.api [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120730) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:08:57.447563 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:57.448038 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:57.448497 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:57.449172 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:57.449619 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:57.450032 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:57.485569 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:57.486060 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:57.486498 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG oslo_concurrency.lockutils [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:57.486947 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.objects.instance [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lazy-loading 'fault' on Instance uuid 403fcf42-32f4-45f9-9a19-8d77fe23c93a {{(pid=120730) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 17:08:57.530216 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.policy [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99baf25bdb4340b8a7947f08e426bd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e75db9cf63624704afe00066b973360b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120730) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 17:08:57.538029 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-9a5f5c66-8672-4008-9b23-edd4f9778d49 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 200 len: 1223 microversion: 2.1 time: 0.101242 Aug 11 17:08:57.539094 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1180/2633] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:08:57 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 17:08:58.561724 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '>' {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:58.562435 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.compute.api [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] [instance: 403fcf42-32f4-45f9-9a19-8d77fe23c93a] Fetching instance by UUID {{(pid=120731) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 17:08:58.569028 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:58.569502 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:58.569932 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:58.570610 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Acquiring lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 17:08:58.571060 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 17:08:58.571480 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG oslo_concurrency.lockutils [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Lock "e8ad9f4c-7bec-4087-9085-6ed45237256a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 17:08:58.584750 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.wsgi [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] HTTP exception thrown: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Request method failure captured: Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: request: GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a HTTP/1.1 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept: application/json Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Accept-Encoding: identity Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Connection: close Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Length: 0 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Content-Type: application/json Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Host: 10.222.0.43 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Openstack-System-Scope: None Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: User-Agent: python-urllib3/1.26.11 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Auth-Token: gAAAAABi9Taf74xQOXPjFpdIlH8G_AIZnJMWJwS26vNCiBrXGFULP67fIU-wLfu9y05BrwAZOLFk9ROqHzH3_17-etzmMW88CUZTDHJ9l-8KdOu-Nl4mpFmIPUuw3lBbW0LarkgmN1xNg9v9SEJji6GZSgZlsK8cGuuF9pwXHQsr6SdO78goFA8 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Id: None Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Domain-Name: None Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Identity-Status: Confirmed Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Is-Admin-Project: True Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Id: default Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Domain-Name: Default Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Id: e75db9cf63624704afe00066b973360b Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Project-Name: tempest-TestShelveInstance-1980010116 Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Role: reader,member Aug 11 17:08:58.586287 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Roles: reader,member Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e75db9cf63624704afe00066b973360b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e75db9cf63624704afe00066b973360b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e75db9cf63624704afe00066b973360b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e75db9cf63624704afe00066b973360b"}]}] Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant: tempest-TestShelveInstance-1980010116 Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Id: e75db9cf63624704afe00066b973360b Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-Tenant-Name: tempest-TestShelveInstance-1980010116 Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User: tempest-TestShelveInstance-1980010116-project Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Id: default Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Domain-Name: Default Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Id: 99baf25bdb4340b8a7947f08e426bd46 Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: X-User-Name: tempest-TestShelveInstance-1980010116-project Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: method: > Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: exception: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. Aug 11 17:08:58.587618 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: action_args: {'id': '403fcf42-32f4-45f9-9a19-8d77fe23c93a'} Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: {{(pid=120731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 17:08:58.588356 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. Aug 11 17:08:58.589495 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: ERROR nova.api.openstack.wsgi Aug 11 17:08:58.590645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: DEBUG nova.api.openstack.wsgi [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Returning 404 to user: Instance 403fcf42-32f4-45f9-9a19-8d77fe23c93a could not be found. {{(pid=120731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 17:08:58.590645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO nova.api.openstack.requestlog [None req-29fc8234-1991-423c-bc8a-386964f757c0 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a" status: 404 len: 111 microversion: 2.1 time: 0.030728 Aug 11 17:08:58.590645 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: [pid: 120731|app: 0|req: 1454/2634] 10.222.0.43 () {58 vars in 1236 bytes} [Thu Aug 11 17:08:58 2022] GET /compute/v2.1/servers/403fcf42-32f4-45f9-9a19-8d77fe23c93a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 17:08:58.758487 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: DEBUG nova.api.openstack.wsgi [None req-21a4559c-7353-4526-ac3d-7e93621e21f2 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] Calling method '.version_select at 0x7f614bd1d5e0>' {{(pid=120730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 17:08:58.784254 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO nova.api.openstack.requestlog [None req-21a4559c-7353-4526-ac3d-7e93621e21f2 tempest-TestShelveInstance-1980010116 tempest-TestShelveInstance-1980010116-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-988833824" status: 202 len: 0 microversion: 2.1 time: 0.029597 Aug 11 17:08:58.785040 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: [pid: 120730|app: 0|req: 1181/2635] 10.222.0.43 () {58 vars in 1251 bytes} [Thu Aug 11 17:08:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-988833824 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 17:09:43.833104 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:09:43.833676 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:09:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:09:54.390056 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:09:54.390575 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:11:52.688382 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:11:52.688914 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:12:03.085536 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:12:03.086066 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:12:08.246074 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:12:08.246580 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:13:03.840649 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:13:03.841387 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:13:14.398168 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:13:14.398761 dv-cinder-852208-4-iscsi devstack@n-api.service[120731]: Thu Aug 11 17:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 17:13:19.260938 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 17:13:19.261425 dv-cinder-852208-4-iscsi devstack@n-api.service[120730]: Thu Aug 11 17:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!